Notes on Diffy Qs 



Differential Equations for Engineers 



by Jin Lebl 

April 29, 2013 



2 



Typeset in ETgX. 

Copyright ©2008-2013 Jin Lebl 




This work is licensed under the Creative Commons Attribution-Noncommercial-Share Alike 3.0 
United States License. To view a copy of this license, visit http://creativecoitimons.org/ 
lice nses/by-nc-s a/3 .9/us/ or send a letter to Creative Commons, 171 Second Street, Suite 
300, San Francisco, California, 94105, USA. 

You can use, print, duplicate, share this book as much as you want. You can base your own notes on 
it and reuse parts if you keep the license the same. If you plan to use it commercially (sell it for 
more than just duplicating cost), then you need to contact me and we will work something out. If 
you are printing a course pack for your students, then it is fine if the duplication service is charging 
a fee for printing and selling the printed copy. I consider that duplicating cost. 

During the writing of these notes, the author was in part supported by NSF grant DMS-0900885. 

See http : //www . j irka . org/ dif £yqs/ for more information (including contact information). 



Contents 



Introduction 5 

0. 1 Notes about these notes 5 

0.2 Introduction to differential equations 7 

1 First order ODEs 13 

1.1 Integrals as solutions 13 

1.2 Slope fields . . . ." 18 

1.3 Separable equations 22 

1 .4 Linear equations and the integrating factor 27 

1.5 Substitution 32 

1.6 Autonomous equations 37 

1.7 Numerical methods: Euler's method 42 

2 Higher order linear ODEs 47 

2. 1 Second order linear ODEs 47 

2.2 Constant coefficient second order linear ODEs 51 

2.3 Higher order linear ODEs 57 

2.4 Mechanical vibrations 62 

2.5 Nonhomogeneous equations 70 

2.6 Forced oscillations and resonance 77 

3 Systems of ODEs 85 

3.1 Introduction to systems of ODEs 85 

3.2 Matrices and linear systems 90 

3.3 Linear systems of ODEs 99 

3.4 Eigenvalue method 103 

3.5 Two dimensional systems and their vector fields 110 

3.6 Second order systems and applications 115 

3.7 Multiple eigenvalues 124 

3.8 Matrix exponentials 129 

3.9 Nonhomogeneous systems 136 



3 



4 CONTENTS 

4 Fourier series and PDEs 149 

4.1 Boundary value problems 149 

4.2 The trigonometric series 157 

4.3 More on the Fourier series 167 

4.4 Sine and cosine series 176 

4.5 Applications of Fourier series 184 

4.6 PDEs, separation of variables, and the heat equation 190 

4.7 One dimensional wave equation 201 

4.8 D'Alembert solution of the wave equation 208 

4.9 Steady state temperature and the Laplacian 214 

4. 10 Dirichlet problem in the circle and the Poisson kernel 220 

5 Eigenvalue problems 229 

5.1 Sturm-Liouville problems 229 

5.2 Application of eigenfunction series 237 

5.3 Steady periodic solutions 241 

6 The Laplace transform 249 

6.1 The Laplace transform 249 

6.2 Transforms of derivatives and ODEs 256 

6.3 Convolution 264 

6.4 Dirac delta and impulse response 269 

7 Power series methods 277 

7.1 Power series 277 

7.2 Series solutions of linear second order ODEs 285 

7.3 Singular points and the method of Frobenius 292 

Further Reading 301 
Solutions to Selected Exercises 303 
Index 311 



Introduction 



0.1 Notes about these notes 

This book originated from my class notes for teaching Math 286, differential equations, at the 
University of Illinois at Urbana-Champaign in fall 2008 and spring 2009. It is a first course on 
differential equations for engineers. I have also taught Math 285 at UIUC and Math 20D at UCSD 
using this book. The standard book for the UIUC course is Edwards and Penney, Differential 
Equations and Boundary Value Problems: Computing and Modeling [EP], fourth edition. Some 
examples and applications are taken more or less from this book, though they also appear in many 
other sources, of course. Among other books I have used as sources of information and inspiration 
are E.L. Ince's classic (and inexpensive) Ordinary Differential Equations [I], Stanley Farlow's 
Differential Equations and Their Applications [F], which is now available from Dover, Berg and 
McGregor's Elementary Partial Differential Equations [BMI . and Boyce and DiPrima's Elementary 
Differential Equations and Boundary Value Problems [BP] , See the Further Reading chapter at the 
end of the book. 

I taught the UIUC courses with the lODE software (http : //www . math . uiuc . edu/iode/). 
lODE is a free software package that is used either with Matlab (proprietary) or Octave (free 
software). Projects and labs from the lODE website are referenced throughout the book. They need 
not be used for this course, but I recommend using them. The graphs in the book were made with 
the Genius software (see http : //www . j irka . org/genius . html). I have used Genius in class to 
show these (and other) graphs. 

This book is available from http : //www . j irka . org/di f fyqs/. Check there for any possible 
updates or errata. The ETgX source is also available from the same site for possible modification 
and customization. 

I would like to acknowledge Rick Laugesen. I have used his handwritten class notes the first 
time I taught Math 286. My organization of this book, and the choice of material covered, is heavily 
influenced by his class notes. Many examples and computations are taken from his notes. I am also 
heavily indebted to Rick for all the advice he has given me, not just on teaching Math 286. For 
spotting errors and other suggestions, I would also like to acknowledge (in no particular order): John 
P. D'Angelo, Sean Raleigh, Jessica Robinson, Michael Angelini, Leonardo Gomes, Jeff Winegar, 
Ian Simon, Thomas Wicklund, Eliot Brenner, Sean Robinson, Jannett Susberry, Dana Al-Quadi, 
Cesar Alvarez, Cem Bagdatlioglu, Nathan Wong, Alison Shive, Shawn White, Wing Yip Ho, Joanne 
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Shin, Gladys Cruz, Jonathan Gomez, Janelle Louie, Navid Froutan, Grace Victorine, Paul Pearson, 
Jared Teague, Ziad Adwan, Martin Weilandt, Sonmez §ahutoglu, Pete Peterson, Thomas Gresham, 
Prentiss Hyde, Jai Welch, and probably others I have forgotten. Finally I would like to acknowledge 
NSF grant DMS-0900885. 

The organization of this book to some degree requires that chapters are done in order. Later 
chapters can be dropped. The dependence of the material covered is roughly: 



Introduction i 



Chapter 1 



Chapter 2 




Chapter 4 



i Chapter 5 ; 

There are some references in chapters 4 and 5 to material from chapter 3 (some linear algebra), 
but these references are not absolutely essential and can be skimmed over, so chapter 3 can safely 
be dropped, while still covering chapters 4 and 5. The textbook was originally done for two types of 
courses. Either at 4 hours a week for a semester (Math 286 at UIUC): 

Introduction, chapter 1, chapter 2, chapter 3, chapter 4 (w/o § 4.10) , chapter 5 (or 6^ or 7). 

Or a shorter version (Math 285 at UIUC) of the course at 3 hours a week for a semester: 

Introduction, chapter 1, chapter 2, chapter 4 (w/o § 4.10), (and maybe chapter 5, 6, or 7). 

The complete book can be covered in approximately 65 lectures, that of course depends on 
the lecturers speed and does not account for exams, review, or time spent in computer lab (if for 
example using lODE). Therefore, a two quarter course can easily be run with the material, and if 
one goes a bit slower than I do, then even a two semester course. 

The chapter on Laplace transform (chapter 6), the chapter on Sturm-Liouville (chapter 5), and 
the chapter on power series (chapter 7) are more or less interchangeable time-wise. If time is short 
the first two sections of the chapter on power series (chapter 7) make a reasonable self-contained 
unit. 
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0.2 Introduction to differential equations 

Note: more than 1 lecture, §1.1 in [EPJ, chapter 1 in [BDJ 

0.2.1 Differential equations 

The laws of physics are generally written down as differential equations. Therefore, all of science 
and engineering use differential equations to some degree. Understanding differential equations is 
essential to understanding almost anything you will study in your science and engineering classes. 
You can think of mathematics as the language of science, and differential equations are one of 
the most important parts of this language as far as science and engineering are concerned. As 
an analogy, suppose that all your classes from now on were given in Swahili. Then it would be 
important to first learn Swahili, otherwise you will have a very tough time getting a good grade in 
your other classes. 

You have already seen many differential equations without perhaps knowing about it. And 
you have even solved simple differential equations when you were taking calculus. Let us see an 
example you may not have seen: 

dx ^ 

— + X = 2 cos?. (1) 
at 

Here x is the dependent variable and t is the independent variable. Equation (J_) is a basic example 
of a differential equation. In fact it is an example of n first order differential equation, since it 
involves only the first derivative of the dependent variable. This equation arises from Newton's law 
of cooling where the ambient temperature oscillates with time. 

0.2.2 Solutions of differential equations 

Solving the differential equation means finding x in terms of t. That is, we want to find a function 
of t, which we will call x, such that when we plug x, t, and ^ into (J_), the equation holds. It is the 
same idea as it would be for a normal (algebraic) equation of just x and t. We claim that 

X = x{t) = cos t + s'mt 

is a solution. How do we check? We simply plug x into equation (J_)! First we need to compute ^. 
We find that ^ = - s'mt + cos t. Now let us compute the left hand side of (J_). 

dx 

\- X = {- smt + cos t) + (cos t + smt) = 2 cos t. 

dt 

Yay! We got precisely the right hand side. But there is more! We claim x = cos t + sint + e~' is also 
a solution. Let us try, 

dx . 

— = - sm ? + cos t - e . 
dt 
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Again plugging into the left hand side of (I) 

dx 



dt 



+ X = (- sin ? + cos t - e ') + (cos ? + sin ? + e = 2 cos t. 



And it works yet again! 

So there can be many different solutions. In fact, for this equation all solutions can be written in 
the form 

X = cos t + s'mt + Ce'' 

for some constant C. See Figure 1 for the graph of a few of these solutions. We will see how we 
can find these solutions a few lectures from now. 

It turns out that solving differential equations 
can be quite hard. There is no general method 
that solves every differential equation. We will 
generally focus on how to get exact formulas for 
solutions of certain differential equations, but we 
will also spend a little bit of time on getting ap- 
proximate solutions. 

For most of the course we will look at ordi- 
nary differential equations or ODEs, by which we 
mean that there is only one independent variable 
and derivatives are only with respect to this one 
variable. If there are several independent vari- 
ables, we will get partial differential equations or 
PDEs. We will briefly see these near the end of 
the course. 

Even for ODEs, which are very well under- 
stood, it is not a simple question of turning a crank to get answers. It is important to know when it 
is easy to find solutions and how to do so. Although in real applications you will leave much of the 
actual calculations to computers, you need to understand what they are doing. It is often necessary 
to simplify or transform your equations into something that a computer can understand and solve. 
You may need to make certain assumptions and changes in your model to achieve this. 

To be a successful engineer or scientist, you will be required to solve problems in your job that 
you have never seen before. It is important to learn problem solving techniques, so that you may 
apply those techniques to new problems. A common mistake is to expect to learn some prescription 
for solving all the problems you will encounter in your later career. This course is no exception. 




Figure 1 : Few solutions of ^ + x = 2 cos t. 



0.2.3 Differential equations in practice 



So how do we use differential equations in science and engineering? First, we have some real 
world problem that we wish to understand. We make some simplifying assumptions and create a 
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Real world problem 



abstract 

Mathematical 
model 



solve 



interpret 

Mathematical 
solution 



mathematical model. That is, we translate the real world situation into a set of differential equations. 
Then we apply mathematics to get some sort of a mathematical solution. There is still something 
left to do. We have to interpret the results. We have to figure out what the mathematical solution 
says about the real world problem we started with. 

Learning how to formulate the mathematical 
model and how to interpret the results is what 
your physics and engineering classes do. In this 
course we will focus mostly on the mathematical 
analysis. Sometimes we will work with simple real 
world examples, so that we have some intuition 
and motivation about what we are doing. 

Let us look at an example of this process. One of the most basic difi'erential equations is the 
standard exponential growth model. Let P denote the population of some bacteria on a Petri dish. 
We assume that there is enough food and enough space. Then the rate of growth of bacteria is 
proportional to the population — a large population grows quicker. Let t denote time (say in seconds) 
and P the population. Our model is 

dP , „ 
— =kP, 
dt 

for some positive constant k > 0. 

Example 0.2.1: Suppose there are 100 bacteria at time and 200 bacteria 10 seconds later. How 
many bacteria will there be 1 minute from time (in 60 seconds)? 

First we have to solve the equation. We claim that a solution is given by 



Pit) = Ce''\ 



where C is a constant. Let us try: 



dP 
dt 



= Cke'" = kP. 



And it really is a solution. 

OK, so what now? We do not know C and we do not know k. But we know something. We 
know that P{0) = 100, and we also know that i'(lO) = 200. Let us plug these conditions in and see 
what happens. 

100 = PiO) = Ce^° = C, 
200 = ^(10) = 100e^i°. 

Therefore, 2 = e^^'' or = k ^ 0.069. So we know that 



P(t) = 100 e' 



(ln2)</10 



100 e' 



0.069r 



At one minute, t = 60, the population is ^(60) = 6400. See Figure 2 on the next page. 
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Let us talk about the interpretation of the results. Does our solution mean that there must 
be exactly 6400 bacteria on the plate at 60s? No! We made assumptions that might not be true 
exactly, just approximately. If our assumptions are reasonable, then there will be approximately 
6400 bacteria. Also, in real life P is a discrete quantity, not a real number. However, our model has 
no problem saying that for example at 61 seconds, P{61) « 6859.35. 

Normally, the k in P' = kP is known, and 
we want to solve the equation for different initial 
conditions. What does that mean? Take k = I 
for simplicity. Now suppose we want to solve 
the equation '-^ = P subject to P(0) = 1000 (the 
initial condition). Then the solution turns out to 
be (exercise) 

P{t) = 1000 e'. 

We call P{t) = Ce' the general solution, as 
every solution of the equation can be written in 
this form for some constant C. You will need an 
initial condition to find out what C is, in order 
to find the particular solution we are looking for. 
Generally, when we say "particular solution," we 
just mean some solution. 

Let us get to what we will call the four fundamental equations. These equations appear very 
often and it is useful to just memorize what their solutions are. These solutions are reasonably easy 
to guess by recalling properties of exponentials, sines, and cosines. They are also simple to check, 
which is something that you should always do. There is no need to wonder if you have remembered 
the solution correctly. 

First such equation is, 

dy 
dx 

for some constant k > 0. Here y is the dependent and x the independent variable. The general 
solution for this equation is 

y{x) = Ce''\ 

We have already seen that this function is a solution above with different variable names. 
Next, 

dy 



Figure 2: Bacteria growth in the first 60 sec- 
onds. 



ky. 



dx 



= -ky. 



for some constant k > 0. The general solution for this equation is 



y{x) = Ce 



-kx 
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Exercise 0.2.1; Check that the y given is really a solution to the equation. 
Next, take the second order differential equation 

for some constant A: > 0. The general solution for this equation is 

yix) = C\ co%{kx) + C2 sin(Ax). 

Note that because we have a second order differential equation, we have two constants in our general 
solution. 

Exercise 0.2.2; Check that the y given is really a solution to the equation. 
And finally, take the second order diff'erential equation 

— =k^y 

for some constant k>Q. The general solution for this equation is 

y{x) = Cie"' + C2e-'\ 

or 

y(x) = Di cosh(Ax) + D2 sinh(Ax). 
For those that do not know, cosh and sinh are defined by 

coshx = 



2 

sinhjc = 



2 

These functions are sometimes easier to work with than exponentials. They have some nice familiar 

dx ' 



properties such as coshO = 1, sinhO = 0, and j-coshx = sinhjc (no that is not a typo) and 



■4- sinh X = cosh x. 

dx 



Exercise 0.2.3; Check that both forms of the y given are really solutions to the equation. 

An interesting note about cosh: The graph of cosh is the exact shape a hanging chain will make. 
This shape is called a catenary. Contrary to popular belief this is not a parabola. If you invert the 
graph of cosh it is also the ideal arch for supporting its own weight. For example, the gateway 
arch in Saint Louis is an inverted graph of cosh — if it were just a parabola it might fall down. The 
formula used in the design is inscribed inside the arch: 

y = -ni.l ft • cosh(;c/ 127.7 ft) + 757.7 ft. 
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0.2.4 Exercises 

Exercise 0.2.4; Show that x = e^' is a solution to x'" - I2x" + 4Sxf - 64x = 0. 
Exercise 0.2.5; Show that x = e' is not a solution to x'" - Ylx" + 48jc' - 64jc = 0. 
Exercise 0.2.6; Isy = sint a solution ^t* (^) = I - y^? Justify. 

Exercise 0.2.7; Lety" + 1y' - = 0. A/iow try a solution of the form y = e''^for some (unknown) 
constant r. Is this a solution for some r? If so, find all such r. 

Exercise 0.2.8; Verify that x = Ce~^' is a solution to x' = -2x. Find C to solve for the initial 
condition x(0) = 100. 

Exercise 0.2.9; Verify that x = Cie~' + C2e^' is a solution to x" - - 2x = 0. Find C\ and C2 to 
solve for the initial conditions x(0) = 10 and x' (0) = 0. 

Exercise 0.2.10; Find a solution to (x')^ + x^ = 4 using your knowledge of derivatives of functions 
that you know from basic calculus. 

Exercise 0.2.11; Solve: 

a) — = -lOA, A(0) = 5 b) — = 3H, H(0) = 1 

dt dx 

= 4}^' 3^(0) = 0, y'(0) = 1 d)^ = -9x, x(0) = I, x'(0) = 
dx"^ dy^ 

Exercise 0.2.12; Is there a solution to y' = y, such thaty(0) = ^(1)? 
Note: Exercises with numbers 101 and higher have solutions in the back of the book. 
Exercise 0.2.101; Show that x = e~^* is a solution to x" + Ax' + Ax = 0. 
Exercise 0.2.102; Isy = x^ a solution to x^y" -ly = Q? Justify. 

Exercise 0.2.103; Let xy" - = 0. Try a solution of the form y = x^ . Is this a solution for some r? 
If so, find all such r. 

Exercise 0.2.104; Verify that x = C\e' + C2 is a solution to x" - x' = 0. Find C\ and C2 so that x 
satisfies x(0) = 10 and x'(0) = 100. 

Exercise 0.2.105; Solve = 8(p and (p(0) = -9. 



Chapter 1 

First order ODEs 



1.1 Integrals as solutions 

Note: 1 lecture (or less), §1.2 in [EP], covered in §1.2 and §2.1 in [BP ] 
A first order ODE is an equation of the form 

-T- = f(x,y), 
dx 

or just 

y' = f(x,y). 

In general, there is no simple formula or procedure one can follow to find solutions. In the next few 
lectures we will look at special cases where solutions are not difficult to obtain. In this section, let 
us assume that / is a function of x alone, that is, the equation is 

y' = f(x). (1.1) 

We could just integrate (antidifferentiate) both sides with respect to x. 

y'(x) dx = f(x) dx + C, 

that is 

y{x) = fix) dx + C. 

This y(x) is actually the general solution. So to solve (1.1) , we find some antiderivative of f{x) and 
then we add an arbitrary constant to get the general solution. 

Now is a good time to discuss a point about calculus notation and terminology. Calculus 
textbooks muddy the waters by talking about the integral as primarily the so-called indefinite 
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integral. The indefinite integral is really the antiderivative (in fact the whole one-parameter family 
of antiderivative s). There really exists only one integral and that is the definite integral. The only 
reason for the indefinite integral notation is that we can always write an antiderivative as a (definite) 
integral. That is, by the fundamental theorem of calculus we can always write J f(x) dx + C as 

X 

fit) dt + C. 

Hence the terminology to integrate when we may really mean to antidifferentiate. Integration is 
just one way to compute the antiderivative (and it is a way that always works, see the following 
examples). Integration is defined as the area under the graph, it only happens to also compute 
antiderivative s. For sake of consistency, we will keep using the indefinite integral notation when we 
want an antiderivative, and you should always think of the definite integral. 

Example 1.1.1: Find the general solution of y' = 3x^. 

Elementary calculus tells us that the general solution must hey = + C. Let us check: y' = 3x^. 
We have gotten precisely our equation back. 

Normally, we also have an initial condition such as yixo) = yo for some two numbers xo and yo 
ixo is usually 0, but not always). We can then write the solution as a definite integral in a nice way. 
Suppose our problem is y' = fix), yixo) = y^. Then the solution is 

yix)= f fis)ds + yo. (1.2) 

Jxo 

Let us check! We compute y' = fix), via the fundamental theorem of calculus, and by Jupiter, j is a 

fix) dx + yo = yo- It is! 

Do note that the definite integral and the indefinite integral (antidifferentiation) are completely 
different beasts. The definite integral always evaluates to a number. Therefore, (1.2) is a formula 
we can plug into the calculator or a computer, and it will be happy to calculate specific values for us. 
We will easily be able to plot the solution and work with it just like with any other function. It is not 
so crucial to always find a closed form for the antiderivative. 

Example 1.1.2: Solve 

/ = e-^\ y(0) = l. 
By the preceding discussion, the solution must be 

yix) = j e'"' ds + \. 
Jo 

Here is a good way to make fun of your friends taking second semester calculus. Tell them to find 
the closed form solution. Ha ha ha (bad math joke). It is not possible (in closed form). There is 
absolutely nothing wrong with writing the solution as a definite integral. This particular integral is 
in fact very important in statistics. 
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Using this method, we can also solve equations of the fonn 

/ = f(y). 

Let us write the equation in Leibniz notation. 

ax 

Now we use the inverse function theorem from calculus to switch the roles of x and y to obtain 

dx 1 

What we are doing seems like algebra with dx and dy. It is tempting to just do algebra with dx 
and dy as if they were numbers. And in this case it does work. Be careful, however, as this sort of 
hand- waving calculation can lead to trouble, especially when more than one independent variable is 
involved. At this point we can simply integrate. 



Finally, we try to solve for y. 



Example 1.1.3: Previously, we guessed y' = ky (for some k > 0) has the solution y = Ce''^. We 
can now find the solution without guessing. First we note that j = is a solution. Henceforth, we 
assume y i^Q. We write 

dx 1 
dy ky 

We integrate to obtain 

x(y) = X = - In lyl + D, 
k 

where D is an arbitrary constant. Now we solve for y (actually for \y\). 

\y\ = e''''-''^ = e-''^e^\ 

If we replace e~^^ with an arbitrary constant C we can get rid of the absolute value bars (which we 
can do as D was arbitrary). In this way, we also incorporate the solution y = 0. We get the same 
general solution as we guessed before, y = Ce^^. 

Example 1.1.4: Find the general solution of y' = y^. 

First we note that j = is a solution. We can now assume that y ^ 0. Write 

dx _ I 

dy y^ 
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We integrate to get 

x= — +C. 

y 

We solve for y = So the general solution is 

y = TT— or y = 0. 
C - X 

Note the singularities of the solution. If for example C = 1, then the solution "blows up" as we 
approach x - 1. Generally, it is hard to tell from just looking at the equation itself how the solution 
is going to behave. The equation y' = y^ is very nice and defined everywhere, but the solution is 
only defined on some interval (-oo, C) or (C, oo). 

Classical problems leading to differential equations solvable by integration are problems dealing 
with velocity, acceleration and distance. You have surely seen these problems before in your 
calculus class. 

Example 1.1.5: Suppose a car drives at a speed e'^'^ meters per second, where t is time in seconds. 
How far did the car get in 2 seconds (starting att = 0)? How far in 10 seconds? 
Let X denote the distance the car traveled. The equation is 

x' = e'l\ 

We can just integrate this equation to get that 

x{t) = 2e"^ + C. 

We still need to figure out C. We know that when t = 0, then x = 0. That is, x(0) = 0. So 

= ;c(0) = le*^'^ + C = 2 + C. 

Thus C = -2 and 

x(t) = 2e"^ - 2. 

Now we just plug in to get where the car is at 2 and at 10 seconds. We obtain 

x(2) = 2^2/2 _ 2 « 3.44 meters, ;c(10) = 2e^^'^ - 2 « 294 meters. 

Example 1.1.6: Suppose that the car accelerates at a rate of f "^/s^. At time t = the car is at the 1 
meter mark and is traveling at 10 "/s- Where is the car at time t = 10. 

Well this is actually a second order problem. If x is the distance traveled, then x' is the velocity, 
and x" is the acceleration. The equation with initial conditions is 

x" = x(0) = 1, x'(0) = 10. 

What if we say x' = v. Then we have the problem 

v' = ^^ v(0) = 10. 
Once we solve for v, we can integrate and find x. 

Exercise 1.1.1; Solve for v, and then solve for x. Find ^(10) to answer the question. 
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1.1.1 Exercises 

Exercise 1.1.2; Solve ^ = + xfory(l) = 3. 
Exercise 1.1.3; Solve ^ = sin(5jc)/or j(0) = 2. 
Exercise 1.1 A: Solve g = ^ifory(0) = 0. 
Exercise 1.1.5; Solve y' = )^^/or3;(0) = 1. 

Exercise 1.1.6 (Uttle harder); 5o/ve j' = Cv - l)Cy + l)/or ^(O) = 3. 

Exercise 1.1.7; 5o/ve ^ = ^/oryCO) = 0. 

Exercise 1.1.8 (harder); Solve y" = sin x/or y(0) = 0, j'(0) = 2. 

Exercise 1.1.9; A spaceship is traveling at the speed 2t^ + l'^"/s (t is time in seconds). It is pointing 
directly away from earth and at time t = it is 1000 kilometers from earth. How far from earth is it 
at one minute from time t = 0? 

Exercise 1.1.10; Solve ^ = sin(f^) + t, jc(0) = 20. It is OK to leave your answer as a definite 
integral. 

Exercise 1.1.101; Solve ^ = + xandy{Q) = 10. 
Exercise 1.1.102; Solve x' = ^, x(l) = 1. 
Exercise 1.1.103; Solve x' = — yr, jc(0) = f . 

cosW ^ ^ 2 

Exercise 1.1.104; Sid is in a car traveling at speed lOt + 70 miles per hour away from Las Vegas, 
where t is in hours. At t = the Sid is 10 miles away from Vegas. How far from Vegas is Sid 2 hours 
later? 

Exercise 1.1.105; Solve y' = y^, y(0) = 1, where n is a positive integer. Hint: You have to consider 
different cases. 
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1.2 Slope fields 



Note: 1 lecture, §1.3 in [EPJ, §1.1 in [BD] 

At this point it may be good to first try the Lab I and/or Project I from the lODE website: 
http : //www . math . uiuc . edu/iode/. 

As we said, the general first order equation we are studying looks like 

/ = fix,y). 

In general, we cannot simply solve these kinds of equations explicitly. It would be nice if we could 
at least figure out the shape and behavior of the solutions, or if we could find approximate solutions. 



1.2.1 Slope fields 

As you have seen in lODE Lab I (if you did it), the equation y' = f(x,y) gives you a slope at each 
point in the -plane. We can plot the slope at lots of points as a short line through the point 
{x,y) with the slope f(x,y). See Figure 1 
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Figure 1.1: Slope field of / = xy. 



We call this picture the slope field of the equation. If we are given a specific initial condition 
yixo) = ya, we can look at the location (jco,yo) and follow the slopes. See Figure 1.2. 

By looking at the slope field we can get a lot of information about the behavior of solutions. For 
example, in Figure 1.2 we can see what the solutions do when the initial conditions are y{0) > 0, 
y{0) = and y{0) < 0. Note that a small change in the initial condition causes quite different 
behavior. On the other hand, plotting a few solutions of the equation y' = -y, we see that no matter 
what y(0) is, all solutions tend to zero as x tends to infinity. See Figure 1.3 on the facing page. 
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Figure 1.2: Slope field of y' = xy with a graph 
of solutions satisfying ^(O) = 0.2, y(0) = 0, and 
yiO) = -0.2. 
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Figure 1.3: Slope field of y' = -y with a graph of a few solutions. 



1.2.2 Existence and uniqueness 

We wish to ask two fundamental questions about the problem 

(i) Does a solution exisft 

(ii) Is the solution unique (if it exists)? 

What do you think is the answer? The answer seems to be yes to both does it not? Well, pretty 
much. But there are cases when the answer to either question can be no. 

Since generally the equations we encounter in applications come from real life situations, it 
seems logical that a solution always exists. It also has to be unique if we believe our universe is 
deterministic. If the solution does not exist, or if it is not unique, we have probably not devised the 
correct model. Hence, it is good to know when things go wrong and why. 

Example 1.2.1: Attempt to solve: 

/ = -, KO) = 0. 

X 

Integrate to find the general solution y = In |x| + C. Note that the solution does not exist at jc = 0. 
See Figure 1.4 on the next page. 



Example 1.2.2: Solve: 



y = 2^, y(0) = o. 
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Figure 1 .4: Slope field of y' = ^/x. 
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Figure 1.5: Slope field of = 2 a/M with two 
solutions satisfying y(0) = 0. 



See Figure 1.5. Note thaty = is a solution. But another solution is the function 




ifx>0, 
if X < 0. 



It is hard to tell by staring at the slope field that the solution is not unique. Is there any hope? Of 
course there is. We have the following theorem, known as Picard's theorem*. 

Theorem 1.2.1 (Picard's theorem on existence and uniqueness). If fix, y) is continuous (as a 
function of two variables) and ^ exists and is continuous near some (xcjo). then a solution to 

y = f(x,y), y(xo)=yo, 

exists (at least for some small interval ofx's) and is unique. 

Note that the problems y' = Vt, 3^(0) = and y' = 2 sjlyi, y(Q) = do not satisfy the hypothesis 
of the theorem. Even if we can use the theorem, we ought to be careful about this existence business. 
It is quite possible that the solution only exists for a short while. 

Example 1.2.3: For some constant A, solve: 

y'=y\ y(0)=A. 

We know how to solve this equation. First assume that A 0, so y is not equal to zero at least 
for some x near 0. So x' = Vr, so jc = "V.v + C, so y = If y{0) = A, then C = ^/a so 

1 

*Named after the French mathematician Charles Emile Picard (1856 - 1941) 
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If A = 0, then y = is a solution. 

For example, when A = 1 the solution "blows up" at x = 1. Hence, the solution does not exist 
for all X even if the equation is nice everywhere. The equation y' = certainly looks nice. 

For most of this course we will be interested in equations where existence and uniqueness holds, 
and in fact holds "globally" unlike for the equation y' = y"^. 



1.2.3 Exercises 

Exercise 1.2.1; Sketch slope field for y' = e^~^ . How do the solutions behave as x grows? Can you 
guess a particular solution by looking at the slope field? 

Exercise 1.2.2; Sketch slope field for y' = x^. 

Exercise 1.2.3; Sketch slope field for y' = y^. 

Exercise 1.2.4; Is it possible to solve the equation y' = for yifS) = \? Justify. 

Exercise 1.2.5; Is it possible to solve the equation y' = y ^[\x\for j(0) = Q? Is the solution unique? 
Justify. 

Exercise 1.2.6; Match equations y' = \ - x, y' = x - 2y, y' = x{l - y) to slope fields. Justify. 
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Exercise 1.2.7 (challenging); Take y' = f(x,y), y(0) = 0, where f(x,y) > I for all x andy. If the 
solution exists for all x, can you say what happens to y{x) as x goes to positive infinity? Explain. 

Exercise 1.2.8 (challenging); Take {y-x)y' = 0, x{0) = 0. a) Find two distinct solutions, b) Explain 
why this does not violate Picard's theorem. 

Exercise 1.2.101; Sketch the slope field ofy' = y^. Can you visually find the solution that satisfies 
yiO) = 0? 

Exercise 1.2.102; Is it possible to solve y' = xyfor y{0) = 0? Is the solution unique? 
Exercise 1.2.103; Is it possible to solve y' = -^foryil) = 0? 

Exercise 1.2.104; Match equations y' = sinx, y' = cosy, y' = ycos(x) to slope fields. Justify. 
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1.3 Separable equations 

Note: 1 lecture, §1.4 in [EP], §2.2 in [BD] 

When a differential equation is of the forni y' = f(x), we can just integrate: y = f f{x) dx + C. 
Unfortunately this method no longer works for the general form of the equation y' = f{x,y). 
Integrating both sides yields 

y = ^ fix^y) dx + c. 

Notice the dependence on y in the integral. 



1.3.1 Separable equations 

Let us suppose that the equation is separable. That is, let us consider 

y' = f(x)g(y), 

for some functions f(x) and g(y). Let us write the equation in the Leibniz notation 

^ = mg(y). 
ax 

Then we rewrite the equation as 

dy 

— = fix) dx. 

g(y) 

Now both sides look like something we can integrate. We obtain 



J g(y) J 



f(x) dx + C. 



If we can find closed form expressions for these two integrals, we can, perhaps, solve for y. 
Example 1.3.1: Take the equation 



y =xy. 



First note that 3; = is a solution, so assume y from now on. Write the equation as ^ = xy, then 

^ — = X dx + C. 

We compute the antiderivatives to get 

\n\y\ = j+C. 
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Or 

2 2 2 

where D > is some constant. Because y = is a solution and because of the absolute value we 
actually can write: 

y = De^, 

for any number D (including zero or negative). 
We check: 

y' = Dxe^ = x^De^^ = xy. 

Yay! 

We should be a little bit more careful with this method. You may be worried that we were 
integrating in two different variables. We seemed to be doing a different operation to each side. Let 
us work this method out more rigorously. 

^ = mg(y) 
ax 

We rewrite the equation as follows. Note that y = y(x) is a function of x and so is ^ ! 

g(y) dx 

We integrate both sides with respect to x. 

dx = f f(x) dx + C. 

g{y) dx J 

We can use the change of variables formula. 

dy - f fix) dx + C. 

giy) J 

And we are done. 



1.3.2 Implicit solutions 

It is clear that we might sometimes get stuck even if we can do the integration. For example, take 
the separable equation 

We separate variables, 

/ + / A, 

a J = ry + - dy = x dx. 

y \ yJ 
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We integrate to get 

2 2 

or perhaps the easier looking expression (where D = 2C) 

/ + 21n|3;| = x^ + D. 

It is not easy to find the solution explicitly as it is hard to solve for y. We, therefore, leave the 
solution in this form and call it an implicit solution. It is still easy to check that an implicit solution 
satisfies the diff"erential equation. In this case, we diflrerentiate to get 

y' ily + - I = 2x. 

\ yJ 

It is simple to see that the differential equation holds. If you want to compute values for y, you 
might have to be tricky. For example, you can graph x as a function of y, and then flip your paper. 
Computers are also good at some of these tricks. 

We note that the above equation also has the solution y = 0. The general solution is + 2 In \y\ = 
x^ + C together with y = 0. These outlying solutions such as y = are sometimes called singular 
solutions. 



1.3.3 Examples 

Example 1.3.2: Solve x^/ = 1 - + / - x^/, 3;(1) = 0. 
First factor the right hand side to obtain 

xV = (l-x2)(l+/). 

We separate variables, integrate and solve for y 



y' 


\-x 


1 +y^ 


X2 


y' 


1 


1 +);2 






-1 


dxcXaaiy) 






X 


y 


= tan - 



Now solve for the initial condition, = tan(-2 + C) to get C = 2 (or 2 + tt, etc. . . ). The solution we 
are seeking is, therefore, 

y = tan(— - x + 2 1 . 
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Example 1.3.3: Bob made a cup of coffee, and Bob likes to drink coffee only once it will not bum 
him at 60 degrees. Initially at time t = minutes, Bob measured the temperature and the coffee was 
89 degrees Celsius. One minute later, Bob measured the coffee again and it had 85 degrees. The 
temperature of the room (the ambient temperature) is 22 degrees. When should Bob start drinking? 

Let T be the temperature of the coffee, and let A be the ambient (room) temperature. Newton's 
law of cooling states that the rate at which the temperature of the coffee is changing is proportional 
to the difference between the ambient temperature and the temperature of the coffee. That is, 

dT 

for some constant k. For our setup A = 22, r(0) = 89, T(l) = 85. We separate variables and 
integrate (let C and D denote arbitrary constants) 

1 ^ _ _^ 



T-A dt 

ln(r - A) = -kt + C, (note that T - A > 0) 



T-A = De-'", 
T =A + De 



-kt 



That is, r = 22 + Z)e-*^ We plug in the first condition: 89 = 7(0) = 22 + D, and hence D = 67. 
So r = 22 + 67 e''^'. The second condition says 85 = T(l) = 22 + 61 e~^. Solving for k we get 
k = - \n ~ 0.0616. Now we solve for the time t that gives us a temperature of 60 degrees. That 

In 60-22 

is, we solve 60 = 22 + 67e-o"6i6( ggj- ^ _ ___|z_ ^ 9 21 minutes. So Bob can begin to drink the 
coffee at just over 9 minutes from the time Bob made it. That is probably about the amount of time 
it took us to calculate how long it would take. 

Example 1.3.4: Find the general solution to y' = (including singular solutions). 
First note that j = is a solution (a singular solution). So assume that y and write 

-iy' = X, 

y2 

3 ^ 
y 2 

3 6 

y = 



+ C x2+2C' 



1.3.4 Exercises 
Exercise 1.3.1; Solve y' = ^/y. 



Exercise 1.3.2; Solve y' = x^y. 
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dx 

Exercise 1.3.3; Solve — = {x^ - 1) t,for x(0) = 0. 

dt 

dx 

Exercise 1.3.4; Solve — = x s'm{t), for x{0) = 1. 

dt 

dy 

Exercise 1.3.5; Solve — = xy + x + y + I. Hint: Factor the right hand side. 

dx 

Exercise 1.3.6; Solve xy' = y + 2x^y, where y(l) = 1. 

dy y^ + I 

Exercise 1.3.7; Solve — = — ,fory(0) = 1. 

dx x^ + \ 

dy x^ + I 

Exercise 1.3.8; Find an implicit solution for — = — — -,fory(0) = 1. 

dx y^ + \ 

Exercise 1.3.9; Find an explicit solution for y' = xe~^, y{0) = 1. 
Exercise 1.3.10; Find an explicit solution for xy' = e~^', for y{\) = 1. 

2 

Exercise 1.3.11; Find an explicit solution for y' = ye~^ , y{0) = 1. It is alright to leave a definite 
integral in your answer. 

Exercise 1.3.12; Suppose a cup of coffee is at 100 degrees Celsius at time t = 0, it is at 70 degrees 
at t = 10 minutes, and it is at 50 degrees at t = 20 minutes. Compute the ambient temperature. 

Exercise 1.3.101; Solve y' = 2xy. 

Exercise 1.3.102; Solve x' = 3xt^ - 3t^, x(0) = 2. 

Exercise 1.3.103; Find an implicit solution for x' = j^^, x{0) = 1. 

Exercise 1.3.104; Find an explicit solution to xy' = y^, y(\) = 1. 



Exercise 1.3.105; Find an implicit solution toy' - , 

^ cos(y) 



sin(x) 
cos(y) ■ 

Exercise 1.3.106; Take Example 1.3.3 with the same numbers: 89 degrees at t = 0, 85 degrees at 
t = \, and ambient temperature of 22 degrees. Suppose these temperatures were measured with 
precision of ±0.5 degrees. Given this imprecision, the time it takes the coffee to cool to (exactly) 
60 degrees is also only known in a certain range. Find this range. Hint: Think about what kind of 
error makes the cooling time longer and what shorter. 
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1.4 Linear equations and the integrating factor 

Note: 1 lecture, §1.5 in [EP], §2.1 in [BD] 

One of the most important types of equations we will learn how to solve are the so-called linear 
equations. In fact, the majority of the course is about linear equations. In this lecture we focus on 
the first order linear equation. A first order equation is linear if we can put it into the form: 

y + p{x)y = fix). (1.3) 

Here the word "linear" means linear in y and y'; no higher powers nor functions of y or y' appear. 
The dependence on x can be more complicated. 

Solutions of linear equations have nice properties. For example, the solution exists wherever 
p{x) and f{x) are defined, and has the same regularity (read: it is just as nice). But most importantly 
for us right now, there is a method for solving linear first order equations. 

The trick is to rewrite the left hand side of (1.3) as a derivative of a product of y with another 
function. To this end we find a function r{x) such that 

r{x)y' + r{x)p{x)y = ^[K-^)^]- 
This is the left hand side of (1.3) multiplied by r{x). So if we multiply (1.3) by r{x), we obtain 

-^[r(jc)j] = r{x)f{x). 

Now we integrate both sides. The right hand side does not depend on y and the left hand side is 
written as a derivative of a function. Afterwards, we solve for y. The function r{x) is called the 
integrating factor and the method is called the integrating factor method. 

We are looking for a function r{x), such that if we differentiate it, we get the same function back 
multiplied by p{x). That seems like a job for the exponential function! Let 

r{x) = 

We compute: 

y' + p{x)y = fix), 
dx L J 

^lp(x)dxy^ J ^lp(x)dxj-(^^-^ JX + C, 



y 



Of course, to get a closed form formula for y, we need to be able to find a closed form formula 
for the integrals appearing above. 
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Example 1.4.1: Solve 

y + 2xy = e''-''\ ym = -l. 

First note that p(x) = 2x and f(x) = e^~^^ . The integrating factor is r(x) = g/^'W^^ = . We 
multiply both sides of the equation by r{x) to get 

e''y + 2xe-''y = e'-''e-'\ 

We integrate 

e^V = + C, 
y = e'-'' +Ce-'\ 



Next, we solve for the initial condition -1 = y{0) = 1 + C, so C = -2. The solution is 

2 2 

y = e'-' - 2e-' . 



Note that we do not care which antiderivative we take when computing You can always 

add a constant of integration, but those constants will not matter in the end. 

Exercise 1.4.1; Try it! Add a constant of integration to the integral in the integrating factor and 
show that the solution you get in the end is the same as what we got above. 

An advice: Do not try to remember the formula itself, that is way too hard. It is easier to 
remember the process and repeat it. 

Since we cannot always evaluate the integrals in closed form, it is useful to know how to write 
the solution in definite integral form. A definite integral is something that you can plug into a 
computer or a calculator. Suppose we are given 

y + p{x)y = fix), yixo) = yo. 

Look at the solution and write the integrals as definite integrals. 



y(x) = ,-^-.-0— I re^>''^''yit)dt + yo\. (1.4) 

JXQ 



You should be careful to properly use dummy variables here. If you now plug such a formula into a 
computer or a calculator, it will be happy to give you numerical answers. 

Exercise 1.4.2; Check thaty{xo) = yo in formula (1.4). 



1.4. LINEAR EQUATIONS AND THE INTEGRATING FACTOR 



29 



Exercise 1.4.3; Write the solution of the following problem as a definite integral, but try to simplify 
as far as you can. You will not be able to find the solution in closed form. 



y' + y = e-" 



y(0) = 10. 



Remark 1.4.1: Before we move on, we should note some interesting properties of linear equations. 
First, for the linear initial value problem y' + p(x)y = f{x), yixo) = y^, there is always an explicit 
formula (1.4) for the solution. Second, it follows from the formula (1.4) that if p{x) and f{x) 
are continuous on some interval {a, b), then the solution y(x) exists and is differentiable on (a, b). 
Compare with the simple nonlinear example we have seen previously, y' = y^, and compare to 
Theorem 1.2.1. 

Example 1.4.2: Let us discuss a common simple application of linear equations. This type of 
problem is used often in real life. For example, linear equations are used in figuring out the 
concentration of chemicals in bodies of water (rivers and lakes). 

A 100 liter tank contains 10 kilograms of salt dissolved in 60 liters of 
water. Solution of water and salt (brine) with concentration of 0. 1 kilograms 
per liter is flowing in at the rate of 5 liters a minute. The solution in the 
tank is well stirred and flows out at a rate of 3 liters a minute. How much 
salt is in the tank when the tank is full? 

Let us come up with the equation. Let x denote the kilograms of salt 
in the tank, let t denote the time in minutes. For a small change At in time, 
the change in x (denoted Ax) is approximately 



SVmin, 0.1 k^L 



60 L 
10 kg of sak 



/1\ 



Ax « (rate in x concentration m)At - (rate out x concentration out)A?. 
Dividing through by At and taking the limit A? ^ we see that 

— = (rate in x concentration in) - (rate out x concentration out). 
dt 



3yn 



In our example, we have 



rate in = 5, 
concentration in = 0.1, 
rate out = 3, 

X 

concentration out = 



X 



volume 60 + (5 - 3)t 



Our equation is, therefore. 



Or in the form (1.3) 



? = (5x0.1) -(3-V)- 
dt ^ ^ \ 60 + 2tl 



dx 3 ^ , 

-r + — ^-^ = 0-5- 
dt 60 + It 
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Let us solve. The integrating factor is 
r(t) = exp U ^^1^^^) = exp ln(60 + 2?) j = (60 + 2tf\ 

We multiply both sides of the equation to get 

dx 3 
(60 + 2tf'^— + (60 + 2tf^-——x = 0.5(60 + 2tf^, 
at 60 + 2t 

^ [(60 + 2tf^x] = 0.5(60 + 2tf^, 

(60 + 2tf'^x = J 0.5(60 + 2tf^dt + C, 

x = (60 + 2tr'l^ J ^^^l^dt + C(60 + 2tr"\ 

X = (60 + 20"^^^^(60 + 2tf^ + C(60 + 2tr^'\ 

^^60 + 2^_^ 
10 

We need to find C. We know that at ? = 0, x = 10. So 
10 = x(0) = Y^ + C(60)-^'^ = 6 + C(60)-^/^ 

or 

C = 4(60^'^) « 1859.03. 

We are interested in x when the tank is full. So we note that the tank 
is full when 60 + 2? = 100, or when t = 20. So 

jc(20) = ^^j^ + C(60 + 40)-^/^ « 10 + 1859.03(100)-^/^ ^ ^ 

The concentration at the end is approximately 0.1186 "^^^/liter and we 
started with i/e or 0.167 ^^ter. 



1.4.1 Exercises 

In the exercises, feel free to leave answer as a definite integral if a closed form solution cannot be 
found. If you can find a closed form solution, you should give that. 

Exercise 1.4.4; Solve y' + xy = x. 

Exercise 1.4.5; Solve y' + 6y = e^. 
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Exercise 1.4.6; Solve y' + 3x^y = sm(x)e~^ , withy(0) = 1. 
Exercise 1.4.7; Solve y' + cos(x)3; = cos(x). 
Exercise 1.4.8; Solve y' + xy = 3, with y(0) = 0. 

Exercise 1.4.9; Suppose there are two lakes located on a stream. Clean water flows into the first 
lake, then the water from the first lakefiows into the second lake, and then water from the second 
lake flows further downstream. The in and out flow from each lake is 500 liters per hour Theflrst 
lake contains 100 thousand liters of water and the second lake contains 200 thousand liters of water. 
A truck with 500 kg of toxic substance crashes into the first lake. Assume that the water is being 
continually mixed perfectly by the stream, a) Find the concentration of toxic substance as a function 
of time in both lakes, b) When will the concentration in the first lake be below 0.001 kg per liter? c) 
When will the concentration in the second lake be maximal? 

Exercise 1.4.10; Newton's law of cooling states that ^ = -k(x - A) where x is the temperature, 
t is time, A is the ambient temperature, and k > is a constant. Suppose that A = Aq cos(iot) for 
some constants Aq and oj. That is, the ambient temperature oscillates (for example night and day 
temperatures), a) Find the general solution, b) In the long term, will the initial conditions make 
much of a difiFerence? Why or why not? 

Exercise 1.4.11; Initially 5 grams of salt are dissolved in 20 liters of water. Brine with concentration 
of salt 2 grams of salt per liter is added at a rate of 3 liters a minute. The tank is mixed well and is 
drained at 3 liters a minute. How long does the process have to continue until there are 20 grams of 
salt in the tank? 

Exercise 1.4.12; Initially a tank contains 10 liters of pure water Brine of unknown (but constant) 
concentration of salt is flowing in at 1 liter per minute. The water is mixed well and drained at 1 
liter per minute. In 20 minutes there are 15 grams of salt in the tank. What is the concentration of 
salt in the incoming brine? 

Exercise 1.4.101; Solve / + 2)X^y = x^. 

Exercise 1.4.102; Solve y' + 2 sm(2x)y = 2 sm(2x), y(i2) = 3. 

Exercise 1.4.103; Suppose a water tank is being pumped out at 3 ^mm. The water tank starts at lOL 
of clean water Water with toxic substance is flowing into the tank at 2 ^min, with concentration 20? fi, 
at time t. When the tank is half empty, how many grams of toxic substance are in the tank (assuming 
perfect mixing)? 



Exercise 1.4.104; Suppose we have bacteria on a plate and suppose that we are slowly adding a 

dP 

dt 



toxic substance such that the rate of growth is slowing down. That is, suppose that ^ = (2 - 0.1t)P. 



IfP(0) = 1000, find the population at t = 5. 
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1.5 Substitution 

Note: 1 lecture, §1.6 in [EP], not in [BD] 

Just as when solving integrals, one method to try is to change variables to end up with a simpler 
equation to solve. 



1.5.1 Substitution 

The equation 

y' = (x-y+lf 

is neither separable nor linear. What can we do? How about trying to change variables, so that in 
the new variables the equation is simpler. We use another variable v, which we treat as a function of 
X. Let us try 

V = X - y + \. 

We need to figure out y' in terms of v', v and x. We differentiate (in x) to obtain v' = I - y' . So 
y = 1 - v'. We plug this into the equation to get 

1 - v' = 

In other words, v' = 1 - v^. Such an equation we know how to solve by separating variables: 

1 



So 



1-V2 
V+ 1 



dv = dx. 



V- 1 
v + 1 



V- 1 



X + C, 

^2x+2C 



v-l 

Now we need to "unsubstitute" to obtain 



X - y + 2 
x-y 



De 



2x 



and also the two solutions x-y + I = I or y = x, and x-y + I = -I or y = x + 2. We solve the first 
equation for y. 

x-y + 2 = ix- y)De^-\ 
x-y + 2 = Dxe^" - yDe^\ 



-y + yDe^"" = Dxe^"" -x-2 
yi-l+De^'') = Dxe^"" -x-2 

X 



Dxe^"" -x-2 



y 



De^^ - 1 
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Note that D = gives y = x + 2, but no value of D gives the solution y = x. 

Substitution in differential equations is applied in much the same way that it is applied in 
calculus. You guess. Several different substitutions might work. There are some general things to 
look for. We summarize a few of these in a table. 



When you see 


Try substituting 


yy' 


2 

V = y 


fy' 


3 

V = y 


(cosj)/ 


V = sin 3; 


{smy)y' 


V = cos y 


y'ey 


V = 



Usually you try to substitute in the "most complicated" part of the equation with the hopes of 
simplifying it. The above table is just a rule of thumb. You might have to modify your guesses. If a 
substitution does not work (it does not make the equation any simpler), try a different one. 



1.5.2 Bernoulli equations 

There are some forms of equations where there is a general rule for substitution that always works. 
One such example is the so-called Bernoulli equation*: 

y' + p{x)y = q{x)y\ 

This equation looks a lot like a linear equation except for the y".\fn = ox n = 1, then the equation 
is linear and we can solve it. Otherwise, the substitution v = y^"" transforms the Bernoulli equation 
into a linear equation. Note that n need not be an integer. 

Example 1.5.1: Solve 

xy' + y{x + 1) + xy^ = 0, ^l) = 1. 
First, the equation is Bernoulli {p{x) = {x + I) fx and q{x) = -1). We substitute 

V = y^~^ = y'"^, v' = -^y~^y'. 
In other words, {~^h)y^v' = /. So 

xy' +y{x + 1) + xy^ = 0, 
^^v' +y(x+ l) + xy^ =0, 



-^V + y-\x + I) + X = 0, 

— X 

—V + v(x + 1) + X = 0, 



*There are several things called Bernoulli equations, this is just one of them. The Bernoullis were a prominent 
Swiss family of mathematicians. These particular equations are named for Jacob Bernoulh (1654 - 1705). 



34 



CHAPTER 1. FIRST ORDER ODES 



and finally 

V V = 4. 

X 

Now the equation is linear. We can use the integrating factor method. In particular, we use formula 
(1.4) . Let us assume that .x; > so = x. This assumption is OK, as our initial condition is x = 1. 
Let us compute the integrating factor. Here p(s) from formula (1.4) is zl(£±ll 



4x+4 



We now plug in to (1.4) 

v(x) = e-T/'W^'-'lJ^ ei'i'''^-'>^'*4 ij 

=.-v(j;'4?;:^*.,). 

Note that the integral in this expression is not possible to find in closed form. As we said before, it 
is perfectly fine to have a definite integral in our solution. Now "unsubstitute" 



-x+l 



y = • 

x(4f^ ^—dt+1) 



1.5.3 Homogeneous equations 

Another type of equations we can solve by substitution are the so-called homogeneous equations. 
Suppose that we can write the diff"erential equation as 



X 



Here we try the substitutions 



y 

V = - and therefore y' =v + xv'. 

X 

We note that the equation is transformed into 

V 1 

V + XV = F{v) or XV = F{v) - v or = - . 

F{v) - V X 
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Hence an implicit solution is 



I F(v) 



dv = In |x| + C. 



V 

Example 1.5.2: Solve 

We put the equation into the form y' = (y/x)^ + y/x. We substitute v = y/x to get the separable 
equation 



xv' = + V - V = v^. 



which has a solution 



We unsubstitute 



We want3;(l) = 1, so 



1=J(1) = 



2 dv = In |x| + C, 
— = In + C, 

V 

-1 

^ ~ In |jc| + C' 

y ^ -1 
X ln|x| + C' 

-X 

^~ In \x\ + C' 

-1 -1 



ln|l| + C C 
Thus C = -1 and the solution we are looking for is 



-X 

y 



In 1^1 - 1 

1.5.4 Exercises 

Hint: Answers need not always be in closed form. 
Exercise 1.5.1; Solve y' + y(x^ - 1) + xy^ = 0, with y(l) = 1. 
Exercise 1.5.2: Solve 2yy' + 1 =y^ + x, with y(0) = 1. 
Exercise 1.5.3; Solve y' + xy = y^, with y(0) = 1. 
Exercise 1.5.4; Solve yy' + x = yjx^ + _y^. 
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Exercise 1.5.5; Solve y' = (x + y - 1)^. 
Exercise 1.5.6; Solve y' = withy (I) = 2. 
Exercise 1.5.101; i'o/ve xy' + j + = 0, ^(l) = 2. 
Exercise 1.5.102; Solve xy' + y + x = 0, y(l) = 1. 
Exercise 1.5.103; Solve y^y' = y^ - 3x, y(0) = 2. 
Exercise 1.5.104; Solve 2yy' = e^""^ + 2x. 
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1.6 Autonomous equations 

Note: 1 lecture, §2.2 in [EPJ, §2.5 in [BD] 
Let us consider problems of the form 



dx 
dt 



fix). 



where the derivative of solutions depends only on x (the dependent variable). Such equations are 
called autonomous equations. If we think of t as time, the naming comes from the fact that the 
equation is independent of time. 

Let us come back to the cooling coffee problem (see Example 1.3.3). Newton's law of cooling 
says that 

^ = -k{x - A), 
dt 

where x is the temperature, t is time, k is some constant, and A is the ambient temperature. See 
Figure 1.6 for an example with k = 0.3 and A = 5. 

Note the solution x = A {in the figure x = 5). We call these constant solutions the equilibrium 
solutions. The points on the x axis where f{x) = are called critical points. The point x = Ais 
a critical point. In fact, each critical point corresponds to an equilibrium solution. Note also, by 
looking at the graph, that the solution x = Ais "stable" in that small perturbations in x do not lead 
to substantially different solutions as t grows. If we change the initial condition a little bit, then as 
t ^ oo we get X ^ A. We call such critical points stable. In this simple example it turns out that all 
solutions in fact go to A as ? ^ oo. If a critical point is not stable we would say it is unstable. 
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Figure 1.6: Slope field and some solutions of Figure 1.7: Slope field and some solutions of 
= -0.3(.«-5). x' =^.\x(5-x). 
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Let us consider the logistic equation 



— = kx{M - x), 
at 



for some positive k and M. This equation is commonly used to model population if we know the 
limiting population M, that is the maximum sustainable population. The logistic equation leads to 
less catastrophic predictions on world population than x' = kx. In the real world there is no such 
thing as negative population, but we will still consider negative x for the purposes of the math. 

See Figure 1.7 on the preceding page for an example. Note two critical points, x = and x = 5. 
The critical point at jc = 5 is stable. On the other hand the critical point at jc = is unstable. 

It is not really necessary to find the exact solutions to talk about the long term behavior of the 
solutions. For example, from the above we can easily see that 



Where DNE means "does not exist." From just looking at the slope field we cannot quite decide 
what happens if x(0) < 0. It could be that the solution does not exist for t all the way to oo. Think 
of the equation x' = x^, we have seen that it only exists for some finite period of time. Same can 
happen here. In our example equation above it will actually turn out that the solution does not exist 
for all time, but to see that we would have to solve the equation. In any case, the solution does go to 
-cx), but it may get there rather quickly. 

Often we are interested only in the long term behavior of the solution and we would be doing 
unnecessary work if we solved the equation exactly. It is easier to just look at the phase diagram or 
phase portrait, which is a simple way to visualize the behavior of autonomous equations. In this 
case there is one dependent variable x. We draw the x axis, we mark all the critical points, and then 
we draw arrows in between. If f(x) > 0, we draw an up arrow. If f(x) < 0, we draw a down arrow. 



Armed with the phase diagram, it is easy to sketch the solutions approximately. 

Exercise 1.6.1; Try sketching a few solutions simply from looking at the phase diagram. Check 
with the preceding graphs if you are getting the type of curves. 




5 if x(0) > 0, 

if x(0) = 0, 

DNE or - oo if x(0) < 0. 



X = 5 



x = 
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Once we draw the phase diagram, we can easily classify critical points as stable or unstable*. 



▲ t 

unstable 

V ▲ V 



stable 



Since any mathematical model we cook up will only be an approximation to the real world, 
unstable points are generally bad news. 

Let us think about the logistic equation with harvesting. Suppose an alien race really likes to 
eat humans. They keep a planet with humans on it and harvest the humans at a rate of h million 
humans per year. Suppose x is the number of humans in millions on the planet and t is time in years. 
Let M be the limiting population when no harvesting is done, k > Ois some constant depending on 
how fast humans multiply. Our equation becomes 

dx 



dt 



= kx{M - x)-h. 



We expand the right hand side and solve for critical points 

dx 9 

— = -kx + kMx - h. 
dt 



Critical points A and B are 

kM+ ^j{kMf - 4hk 



A = 



2k 



B = 



kM- y/{kMf - 4hk 



2k 



Exercise 1.6.2; Draw the phase diagram for different possibilities. Note that these possibilities are 
A > B, or A = B, or A and B both complex (i.e. no real solutions). Hint: Fix some simple k and M 
and then vary h. 

For example, let M = 8 and k = O.l. When h = I, then A and B are distinct and positive. The 
graph we will get is given in Figure 1.8 on the next page. As long as the population starts above B, 
which is approximately 1 .55 million, then the population will not die out. It will in fact tend towards 
A X 6.45 million. If ever some catastrophe happens and the population drops below B, humans will 
die out, and the fast food restaurant serving them will go out of business. 

When h = 1.6, then A = B = 4. There is only one critical point and it is unstable. When the 
population starts above 4 million it will tend towards 4 million. If it ever drops below 4 million, 
humans will die out on the planet. This scenario is not one that we (as the human fast food proprietor) 
want to be in. A small perturbation of the equilibrium state and we are out of business. There is no 
room for error. See Figure 1 .9 on the following page. 

Finally if we are harvesting at 2 million humans per year, there are no critical points. The 
population will always plummet towards zero, no matter how well stocked the planet starts. See 
Figure 1.10 on the next page. 



*The unstable points that have one of the arrows pointing towards the critical point are sometimes called semistable. 
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Figure 1.8: Slope field and some solutions of Figure 1.9: Slope field and some solutions of 
x' =0.1x(8-x)- 1. x' =0.1jc(8-x)- 1.6. 
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Figure 1.10: Slope field and some solutions of = 0.1 x(8 - - 2. 



1.6.1 Exercises 

Exercise 1.6.3; Let x' = x^. a) Draw the phase diagram, find the critical points and mark them 
stable or unstable, b) Sketch typical solutions of the equation, c) Find lim x{t)for the solution with 

the initial condition x{0) = -1. 

Exercise 1.6.4; Let x' = sinx a) Draw the phase diagram for —An < x < An. On this interval 
mark the critical points stable or unstable, b) Sketch typical solutions of the equation, c) Find 
lim,^oo x{t)for the solution with the initial condition x{0) = 1. 

Exercise 1.6.5; Suppose f(x) is positive for < x < I, it is zero when x = and x = I, and it is 
negative for all other x. a) Draw the phase diagram for x' = f(x), find the critical points and mark 
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them stable or unstable, b) Sketch typical solutions of the equation, c) Find limx(t)for the solution 

t—*oo 

with the initial condition x(0) = 0.5. 

Exercise 1.6.6; Start with the logistic equation ^ = kx{M - x). Suppose that we modify our 
harvesting. That is we will only harvest an amount proportional to current population. In other 
words we harvest hx per unit of time for some h > (Similar to earlier example with h replaced 
with hx). a) Construct the differential equation, b) Show that ifkM > h, then the equation is still 
logistic, c) What happens when kM <h? 

Exercise 1.6.101; Let x' = {x- l)(x - 2)x^. a) Sketch the phase diagram and find critical points, 
b) Classify the critical points, c) lfx(0) = 0.5 then find \imx(t). 

t—*oo 

Exercise 1.6.102; Let xf = e~^. a) Find and classify all critical points, b) Find lim x(t) given any 

t—yoo 

initial condition. 

Exercise 1.6.103; Assume that a population offish in a lake satisfies ^ = kx(M - x). Now suppose 
that fish are continually added at A fish per unit of time, a) Find the differential equation for x. b) 
What is the new limiting population? 
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1.7 Numerical methods: Euler's method 

Note: 1 lecture, §2.4 in [EPJ, §8.1 in [BD] 

At this point it may be good to first try the Lab II and/or Project II from the lODE website: 
http : //www . math . uiuc . edu/iode/. 

As we said before, unless fix,y) is of a special form, it is generally very hard if not impossible 
to get a nice formula for the solution of the problem 

y' = fix,y), y{xo)=yQ. 

What if we want to find the value of the solution at some particular jc? Or perhaps we want to 
produce a graph of the solution to inspect the behavior. In this section we will learn about the basics 
of numerical approximation of solutions. 

The simplest method for approximating a solution is Euler's method*. It works as follows: We 
take xq and compute the slope k = f{xo,yo). The slope is the change in y per unit change in x. We 
follow the line for an interval of length h on the x axis. Hence ify = yo at xo, then we will say that 
yi (the approximate value of y at xi = Xq + h) will be yi =yo + hk. Rinse, repeat! That is, compute 
X2 and y2 using xi and yi. For an example of the first two steps of the method see Figure 1.11. 
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Figure 1.11: First two steps of Euler's method with h = I for the equation y' = j with initial 
conditions y{0) = 1 . 



More abstractly, for any i = 1, 2, 3, . . ., we compute 

Xi+i = Xi + h, yi+-i =yi + h f(xi, yd. 

The line segments we get are an approximate graph of the solution. Generally it is not exactly the 
solution. See Figure 1.12 on the next page for the plot of the real solution and the approximation. 

*Named after the Swiss mathematician Leonhard Paul Euler (1707 - 1783). Do note the correct pronunciation of 
the name sounds more like "oiler." 
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Figure 1.12: Two steps of Euler's method (step size 1) and the exact solution for the equation = y 
with initial conditions ^(0) = 1 . 



Let us see what happens with the equation y' = y /s, y(0) = I. Let us try to approximate 3^(2) 
using Euler's method. In Figures 1.11 and 1.12 we have graphically approximated j(2) with step 
size 1. With step size 1 we have y{2) « 1.926. The real answer is 3. So we are approximately 1.074 
off. Let us halve the step size. Computing 3^4 with h = 0.5, we find that y(2) « 2.209, so an error of 
about 0.791. Table 1.1 on the following page gives the values computed for various parameters. 

Exercise 1.7.1; Solve this equation exactly and show thaty(2) = 3. 

The difference between the actual solution and the approximate solution we will call the error. 
We will usually talk about just the size of the error and we do not care much about its sign. The 
main point is, that we usually do not know the real solution, so we only have a vague understanding 
of the error. If we knew the error exactly . . . what is the point of doing the approximation? 

We notice that except for the first few times, every time we halved the interval the error 
approximately halved. This halving of the error is a general feature of Euler's method as it is a 
first order method. In the lODE Project II you are asked to implement a second order method. A 
second order method reduces the error to approximately one quarter every time we halve the interval 
(second order as 1/4 = V2 x 1/2). 

To get the error to be within 0.1 of the answer we had to already do 64 steps. To get it to within 
0.01 we would have to halve another three or four times, meaning doing 512 to 1024 steps. That is 
quite a bit to do by hand. The improved Euler method from lODE Project II should quarter the error 
every time we halve the interval, so we would have to approximately do half as many "halvings" 
to get the same error. This reduction can be a big deal. With 10 halvings (starting at h = 1) we 
have 1024 steps, whereas with 5 halvings we only have to do 32 steps, assuming that the error was 
comparable to start with. A computer may not care about this difference for a problem this simple, 
but suppose each step would take a second to compute (the function may be substantially more 
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h 


Approximate y(2) 


Error 


EiTor 
Previous error 


1 


1.92593 


1.07407 




0.5 


2.20861 


0.79139 


0.73681 


0.25 


2.47250 


0.52751 


0.66656 


0.125 


2.68034 


0.31966 


0.60599 


0.0625 


2.82040 


0.17960 


0.56184 


0.03125 


2.90412 


0.09588 


0.53385 


0.015625 


2.95035 


0.04965 


0.51779 


0.0078125 


2.97472 


0.02528 


0.50913 



Table 1.1: Euler's method approximation of y(2) where of y' = >'73, 3^(0) = 1. 

difficult to compute than Then the difl!'erence is 32 seconds versus about 17 minutes. Note: We 
are not being altogether fair, a second order method would probably double the time to do each step. 
Even so, it is 1 minute versus 17 minutes. Next, suppose that we have to repeat such a calculation 
for different parameters a thousand times. You get the idea. 

Note that in practice we do not know how large the error is! How do we know what is the right 
step size? Well, essentially we keep halving the interval, and if we are lucky, we can estimate the 
error from a few of these calculations and the assumption that the error goes down by a factor of 
one half each time (if we are using standard Euler). 

Exercise 1.7.2; In the table above, suppose you do not know the error. Take the approximate values 
of the function in the last two lines, assume that the error goes down by a factor of 2. Can you 
estimate the error in the last time from this? Does it (approximately) agree with the table? Now do 
it for the first two rows. Does this agree with the table? 

Let us talk a little bit more about the example y' = y(0) = 1. Suppose that instead of the 
value 3^(2) we wish to find 3^(3). The results of this effort are listed in Table 1.2 on the next page for 
successive halvings of h. What is going on here? Well, you should solve the equation exactly and 
you will notice that the solution does not exist at x = 3. In fact, the solution goes to infinity when 
you approach x = 3. 

Another case when things can go bad is if the solution oscillates wildly near some point. Such 
an example is given in lODE Project II. The solution may exist at all points, but even a much better 
numerical method than Euler would need an insanely small step size to approximate the solution 
with reasonable precision. And computers might not be able to easily handle such a small step size. 

In real applications we would not use a simple method such as Euler's. The simplest method that 
would probably be used in a real application is the standard Runge-Kutta method (see exercises). 
That is a fourth order method, meaning that if we halve the interval, the error generally goes down 
by a factor of 16 (it is fourth order as V16 = V2 x 1/2 x V2 x 1/2). 



1.7. NUMERICAL METHODS: EULER 'S METHOD 



45 



h 


Approximate y(3) 


1 


3.16232 


0.5 


4.54329 


0.25 


6.86079 


0.125 


10.80321 


0.0625 


17.59893 


0.03125 


29.46004 


0.015625 


50.40121 


0.0078125 


87.75769 



Table 1.2: Attempts to use Euler's to approximate 3;(3) where of / = y(0) = 1. 

Choosing the right method to use and the right step size can be very tricky. There are several 
competing factors to consider. 

• Computational time: Each step takes computer time. Even if the function / is simple to 
compute, we do it many times over. Large step size means faster computation, but perhaps 
not the right precision. 

• Roundoff errors: Computers only compute with a certain number of significant digits. Errors 
introduced by rounding numbers ofi" during our computations become noticeable when the 
step size becomes too small relative to the quantities we are working with. So reducing step 
size may in fact make errors worse. 

• Stability: Certain equations may be numerically unstable. What may happen is that the 
numbers never seem to stabilize no matter how many times we halve the interval. We may 
need a ridiculously small interval size, which may not be practical due to roundoff errors or 
computational time considerations. Such problems are sometimes called stiff. In the worst 
case, the numerical computations might be giving us bogus numbers that look like a correct 
answer. Just because the numbers have stabilized after successive halving, does not mean that 
we must have the right answer. 

We have seen just the beginnings of the challenges that appear in real applications. Numerical 
approximation of solutions to differential equations is an active research area for engineers and 
mathematicians. For example, the general purpose method used for the ODE solver in Matlab and 
Octave (as of this writing) is a method that appeared in the literature only in the 1980s. 
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1.7.1 Exercises 

dx 2 

Exercise 1.7.3; Consider —= (2t - x) , x(0) = 2. Use Euler's method with step size h = 0.5 to 

dt 

approximate x(l). 

dx 

Exercise 1.7.4: Consider — = t - x, x(0) = 1. a) Use Euler's method with step sizes h = 

dt 

1, 1/2, to approximate x{\). b) Solve the equation exactly, c) Describe what happens to the 

errors for each h you used. That is, find the factor by which the error changed each time you halved 
the interval. 

Exercise 1.7.5; Approximate the value of e by looking at the initial value problem y' = y with 
y(0) = 1 and approximating y{\) using Euler's method with a step size of 0.1. 

Exercise 1.7.6; Example of numerical instability: Take y' = —5y, y{0) = 1. We know that the 
solution should decay to zero as x grows. Using Euler's method, start with h = I and compute 
y\,y2,y3,y4 to try to approximate y(4). What happened? Now halve the interval. Keep halving the 
interval and approximating y{A) until the numbers you are getting start to stabilize ( that is, until 
they start going towards zero). Note: You might want to use a calculator. 

The simplest method used in practice is the Runge-Kutta method. Consider ^ = f{x,y), 
yi^o) = yo, and a step size h. Everything is the same as in Euler's method, except the computation 
ofyi+i andx,+i. 

^1 =f(xi,yi), 

ki = f(xi + H^,yi + kih/i), xm = Xi + h, 

h = f(Xi + V2, + k2^/2), yi+i = yi + h, 

6 

kA = fixi + h,yi + k^h). 

dy , 

Exercise 1.7.7; Consider — = yx , y{0) = 1. a) Use Runge-Kutta (see above) with step sizes h = I 

dx 

and h = 1/2 to approximate y{l). b) Use Euler's methodwith h = 1 and h = 1/2. c) Solve exactly, find 
the exact value ofy(l), and compare. 

Exercise 1.7.101; Let x! = sin(jcO, and x{0) = 1. Approximate x{l) using Euler's method with step 
sizes 1, 0.5, 0.25. Use a calculator and compute up to 4 decimal digits. 

Exercise 1.7.102; Let x' = 2t, and x{0) = 0. a) Approximate x(4) using Euler's method with step 
sizes 4, 2, and 1. b) Solve exactly, and compute the errors, c) Compute the factor by which the 
errors changed. 

Exercise 1.7.103; Let x! = xe^^^, and x(0) = 0. a) Approximate x{A) using Euler's method with 
step sizes 4, 2, and Lb) Guess an exact solution based on part a) and compute the errors. 



Chapter 2 

Higher order linear ODEs 



2.1 Second order linear ODEs 

Note: less than 1 lecture, first part of §3.1 in [EP], parts of §3.1 and §3.2 in [BD] 
Let us consider the general second order linear differential equation 

A{x)y" + B{x)y' + C{x)y = F{x). 

We usually divide through by A{x) to get 

y" + p{x)y' + q{x)y = fix), (2.1) 

where p{x) = ^(-^Vacy), q(x) = '^(^^^Aix), and f(x) = ^(^yA(x). The word linear means that the equation 
contains no powers nor functions of y, y', and y". 

In the special case when f{x) = we have a so-called homogeneous equation 

y" + p(x)y' +q(x)y = 0. (2.2) 

We have already seen some second order linear homogeneous equations. 

y" + k^y = Two solutions are: yi = cos(kx), yj = s'm{kx). 

y" -k^y = Two solutions are: yi = e''", yj = e'^'' . 

If we know two solutions of a linear homogeneous equation, we know a lot more of them. 

Theorem 2.1.1 (Superposition). Suppose y\ andyj are two solutions of the homogeneous equation 
(2.2) . Then 

y{x) = Ciyiix) + C2y2ix), 
also solves (2.2) for arbitrary constants Ci and C2. 
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That is, we can add solutions together and multiply them by constants to obtain new and different 
solutions. We call the expression Ciyi + Cjyi a linear combination of yi and y2. Let us prove this 
theorem; the proof is very enlightening and illustrates how linear equations work. 

Proof: Lety = Ciji + C2y2- Then 

y" + py' +qy = (Ciji + C2y2)" + piC^yx + C2y2)' + <?(Ciji + Caja) 
= Ciy'l + C2)^2 + C\py\ + C2py'2 + Ciqyi + C2qy2 
= Ciiy'l + py\ + <5ryi) + CaCVi + M + lyi) 
= Ci • + C2 • = 0. 

The proof becomes even simpler to state if we use the operator notation. An operator is an 
object that eats functions and spits out functions (kind of like what a function is, but a function eats 
numbers and spits out numbers). Define the operator L by 

Ly = y" + py' + qy. 

The differential equation now becomes Ly = 0. The operator (and the equation) L being linear 
means that L(Ciyi + C^yi) = CiLyi + C2Ly2. The proof above becomes 

Ly = L(Ciyi + Ciyi) = CiLyi + CiLyi = Ci • + C2 • = 0. 

Two different solutions to the second equation)^" - k^y = are 3^1 = cosh{kx) andy2 = sinh{kx). 
Let us remind ourselves of the definition, coshx = ^^-^ and sinhx = Therefore, these are 

solutions by superposition as they are linear combinations of the two exponential solutions. 

The functions sinh and cosh are sometimes more convenient to use than the exponential. Let us 
review some of their properties. 

coshO = l sinhO = 

-f- cosh X = sinh x -f" sinh x = cosh x 

ax ax 

cosh^ X - sinh^ jc = 1 

Exercise 2.1.1; Derive these properties using the definitions o/sinh and cosh in terms of exponen- 
tials. 

Linear equations have nice and simple answers to the existence and uniqueness question. 

Theorem 2.1.2 (Existence and imiqueness). Suppose p, q, f are continuous functions on some 
interval I, a is a number in I, and a, bo, bi are constants. The equation 

y" + p(x)y' + q(x)y = f(x), 

has exactly one solution y{x) defined on the same interval I satisfying the initial conditions 

y(a) = bo, y'(a) = bi. 



2. 1 . SECOND ORDER LINEAR ODES 



49 



For example, the equation y" + 



7 = with y{0) = bo and y'(0) = bi has the solution 



y(x) = bocos(kx) + — s'm{kx). 



k 



The equation y" - k^ 



7 = with _y(0) = Z?o and ^'(O) = bi has the solution 



0\ 

y{x) = bQCO^]\{kx) + — sinh(fcx). 



Using cosh and sinh in this solution allows us to solve for the initial conditions in a cleaner way 
than if we have used the exponentials. 

The initial conditions for a second order ODE consist of two equations. Common sense tells us 
that if we have two arbitrary constants and two equations, then we should be able to solve for the 
constants and find a solution to the differential equation satisfying the initial conditions. 

Question: Suppose we find two different solutions y^ and yj to the homogeneous equation (2.2) . 
Can every solution be written (using superposition) in the form y = Ciy\ + C2y2? 

Answer is affirmative! Provided that yi and j2 are different enough in the following sense. We 
will say yi and yj are linearly independent if one is not a constant multiple of the other. 

Theorem 2.1.3. Let p,q be continuous functions. Let yi and y2 be two linearly independent 
solutions to the homogeneous equation (2.2). Then every other solution is of the form 



That is, y = Ciyi + C2J2 is the general solution. 

For example, we found the solutions yi = sin x and j2 = cos x for the equation y" + y = 0. It is 
not hard to see that sine and cosine are not constant multiples of each other. If s'mx = A cos x for 
some constant A, we let jc = and this would imply A = 0. But then sin a: = for all x, which is 
preposterous. So yi and 3^2 are linearly independent. Hence 



is the general solution to y" + y = 0. 

We will study the solution of nonhomogeneous equations in § 2.5. We will first focus on finding 
general solutions to homogeneous equations. 

2.1.1 Exercises 

Exercise 2.1.2; Show that y = e^ and y = e^^ are linearly independent. 



y = Ciji + C2y2- 



y = Ci cos X + C2 sin x 



Exercise 2.1.3; Take y" + 5y = 10.x; + 5. Find (guess!) a solution. 
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Exercise 2.1.4; Prove the superposition principle for nonhomogeneous equations. Suppose thaty\ 
is a solution to Ly\ = f(x) andy2 is a solution to Ly2 = g(x) (same linear operator L). Show that 
y = yi+y2 solves Ly = fix) + g{x). 

Exercise 2.1.5; For the equation x^y" — xy' = 0, find two solutions, show that they are linearly 
independent and find the general solution. Hint: Try y = x^ . 

Note that equations of the form ax^y" + hx:y' + = are called Euler's equations or Cauchy- 
Euler equations. They are solved by trying y = x'' and solving for r (we can assume that ;c > for 
simplicity). 

Exercise 2.1.6; Suppose that (b - a)^ - 4ac > 0. a) Find a formula for the general solution 
of ax^y" + bxy' + cy = Q. Hint: Try y = x^ and find a formula for r. b) What happens when 
(b - af -4ac = or (b - af - Aac < 0? 

We will revisit the case when {b - a)^ - Aac < later. 

Exercise 2.1.7; Same equation as in Exercise 2.1.6. Suppose (b - a)^ - Aac = 0. Find a formula 
for the general solution ofax^y" + bxy' + cy = 0. Hint: Try y = x'' In x for the second solution. 

If you have one solution to a second order linear homogeneous equation you can find another 
one. This is the reduction of order method. 

Exercise 2.1.8 (reduction of order); Suppose yi is a solution to y" + p{x)y' + q{x)y = 0. Show that 



is also a solution. 

Note: If you wish to come up with the formula for reduction of order yourself, start by trying 
yii^) = yiix)v{x). Then plug y2 into the equation, use the fact that yi is a solution, substitute w = v', 
and you have a first order linear equation in w. Solve for w and then for v. When solving for w, make 
sure to include a constant of integration. Let us solve some famous equations using the method. 

Exercise 2.1.9 (Chebyshev's equation of order 1); Take (1 - x^)y" - xy' + y = 0. a) Show thaty = x 
is a solution, b) Use reduction of order to find a second linearly independent solution, c) Write 
down the general solution. 

Exercise 2.1.10 (Hermite's equation of order 2); Take y" - 2xy' + Ay = 0. a) Show thaty = 1 - 2x^ 
is a solution, b) Use reduction of order to find a second linearly independent solution, c) Write 
down the general solution. 

Exercise 2.1.101; Are sin(jc) and e^ linearly independent? Justify. 
Exercise 2.1.102; Are e^ and e'^^^ linearly independent? Justify. 
Exercise 2.1.103; Guess a solution to y" -\- y' + y = 5. 



Exercise 2.1.104; Find the general solution to xy" + y' = 0. Hint: Notice that it is a first order 
ODE in y. 




2.2. CONSTANT COEFFICIENT SECOND ORDER LINEAR ODES 



51 



2.2 Constant coefficient second order finear ODEs 

Note: more than 1 lecture, second part of §3.1 in [EPJ, §3.1 in [BDJ 
Suppose we have the problem 

y" - 6y' + Sy = 0, y(0) = -2, y'(0) = 6. 

This is a second order linear homogeneous equation with constant coefficients. Constant coefficients 
means that the functions in front of y", y', and y are constants, not depending on x. 

To guess a solution, think of a function that you know stays essentially the same when we 
differentiate it, so that we can take the function and its derivatives, add some multiples of these 
together, and end up with zero. 

Let us try a solution of the form y = e''^. Then y' = re''^ and y" = r^e" . Plug in to get 

y" - 6y' + 83; = 0, 
r^e" - 6re" + Se'' = 0, 

- 6r + 8 = (divide through by e"), 
(r - 2)(r - 4) = 0. 

Hence, if r = 2 or r = 4, then is a solution. So let yi = e^^ and y2 = e"^^. 

Exercise 2.2.1: Check thatyi andy2 are solutions. 

The functions e^^ and e^^ are linearly independent. If they were not linearly independent we 
could write e^^ = Ce^" for some constant C, implying that e^^ = C for all x, which is clearly not 
possible. Hence, we can write the general solution as 

y = Cie^' + C2e^\ 

We need to solve for C\ and C2. To apply the initial conditions we first find y' = 2C\e^^ + AC2e^^ . 
We plug in .x: = and solve. 

-2 = XO) = Ci + C2, 
6 = /(O) = 2Ci + 4C2. 

Either apply some matrix algebra, or just solve these by high school math. For example, divide the 
second equation by 2 to obtain 3 = Ci + 2C2, and subtract the two equations to get 5 = C2. Then 
C\ = -7 as -2 = Ci + 5. Hence, the solution we are looking for is 

y = -le^' + 5e^\ 



Let us generalize this example into a method. Suppose that we have an equation 

ay" + by' + = 0, (2.3) 
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where a, b, c are constants. Try the solution y = e" to obtain 

ar^e" + bre" + ce" = 0, 
ar^ + br + c = 0. 

The equation ar^ + br + c = is called the characteristic equation of the ODE. Solve for the r by 
using the quadratic formula. 

-b+ VZ?^ - Aac 

ruri = . 

2a 

Therefore, we have e''^^ and e''-^ as solutions. There is still a difficulty if r^ = r2, but it is not hard to 
overcome. 

Theorem 2.2.1. Suppose that r^ and r2 are the roots of the characteristic equation. 

(i) Ifri and r2 are distinct and real (when b^ — Aac > 0), then (2.3) has the general solution 

y = Cie''-' + C2e'''\ 

(ii) If r\ = r2 (happens when b^ — Aac = Oj, then (2.3) has the general solution 

y = {Ci+C2X)e'-'\ 

For another example of the first case, take the equation y" - k^y = 0. Here the characteristic 
equation is r^ - = or (r - k){r + k) = 0. Consequently, e^'^^ and e''^ are the two linearly 
independent solutions. 

Example 2.2.1: Find the general solution of 

y" - Sy' + 16y = 0. 

The characteristic equation is - 8r + 16 = (r - 4)^ = 0. The equation has a double root 
ri = r2 = A. The general solution is, therefore, 

y = iCy+ C2X) e'^' = Cye^' + C2xe^-\ 

Exercise 2.2.2; Check that e"*'^ and xe"^^ are linearly independent. 

That e^^ solves the equation is clear. If xe^^ solves the equation, then we know we are done. Let 
us compute y' = e'^^ + Axe^'^ and y" = Se'^^ + I6xe^^. Plug in 

y" -%y' + \6y = %e^' + \6xe'' - %{e'' + Axe^') + I6xe^' = 0. 

We should note that in practice, doubled root rarely happens. If coefficients are picked truly 
randomly we are very unlikely to get a doubled root. 

Let us give a short proof for why the solution xe''^ works when the root is doubled. This case 
is really a limiting case of when the two roots are distinct and very close. Note that is a 

solution when the roots are distinct. When we take the limit as ri goes to ri, we are really taking 
the derivative of using r as the variable. Therefore, the limit is xe''^, and hence this is a solution 
in the doubled root case. 
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2.2.1 Complex numbers and Euler's formula 

It may happen that a polynomial has some complex roots. For example, the equation + 1 = 
has no real roots, but it does have two complex roots. Here we review some properties of complex 
numbers. 

Complex numbers may seem a strange concept, especially because of the terminology. There 
is nothing imaginary or really complicated about complex numbers. A complex number is simply 
a pair of real numbers, (a, b). We can think of a complex number as a point in the plane. We add 
complex numbers in the straightforward way, (a, b) + (c, d) = (a + c,b + d). We define multiplication 
by 

def 

(a, b) X (c, d) = (ac - bd, ad + be). 

It turns out that with this multiplication rule, all the standard properties of arithmetic hold. Further, 
and most importantly (0, 1) X (0, 1) = (-1,0). 

Generally we just write (a, b)asa + ib, and we treat i as if it were an unknown. We do arithmetic 
with complex numbers just as we would with polynomials. The property we just mentioned becomes 

= -1. So whenever we see f, we replace it by -1. The numbers i and -i are the two roots of 

+ 1 = 0. 

Note that engineers often use the letter j instead of / for the square root of -1. We will use the 
mathematicians' convention and use /. 

Exercise 2.2.3; Make sure you understand (that you can justify) the following identities: 

• i^ = -1, i^ = -i, i'^ = 1, 
1 

• - = -I, 

I 

• (3 - 70(-2 - 90 = • • • = -69 - 13/, 

• (3 - 2i)(3 + 2i) = 32 - (2/)2 = 32 + 22 = 13, 

1 _ _i_3±2i _ 3±2i _ i. J. 2_; 
3-2! 3-2; 3+2/ 13 13 13 

We can also define the exponential e"'^''' of a complex number. We do this by writing down the 
Taylor series and plugging in the complex number. Because most properties of the exponential can 

be proved by looking at the Taylor series, these properties still hold for the complex exponential. 
For example the very important property: e^'^^ = e^e^. This means that = e'^e'''. Hence if we 
can compute e'^, we can compute e"^'^. For e''^ we use the so-called Euler's formula. 

Theorem 2.2.2 (Euler's formula). 



e = cos 9 + i sin 6 and e = cos 6 - i sin 6. 
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Exercise 2.2.4: Using Euler's formula, check the identities: 

-I- (>~'^ — (>~'^ 

cos 6= and s'mO = — . 

2 2i 

Exercise 2.2.5: Double angle identities: Start with e'^^^^ = (e'^f'. Use Euler on each side and 
deduce: 

cos(20) = cos^ 6 - sin^ 6 and sin(20) = 2 sin cos 6. 

For a complex number a + ib we call a the real part and b the imaginary part of the number. 
Often the following notation is used, 

Re(a + ib) = a and Im(a + ib) = b. 



2.2.2 Complex roots 



Suppose that the equation ay" + by' + cy = has the characteristic equation ar^ + br + c = that 
has complex roots. By the quadratic fo 
b^ - 4ac < 0. In this case the roots are 



has complex roots. By the quadratic formula, the roots are These roots are complex if 



-b . V4ac - b^ 
^ 2a 2a 

As you can see, we always get a pair of roots of the form a + i/3. In this case we can still write the 
solution as 

y = Cie^""-"^^' + C2e^"-"^^\ 

However, the exponential is now complex valued. We would need to allow Ci and C2 to be complex 
numbers to obtain a real-valued solution (which is what we are after). While there is nothing 
particularly wrong with this approach, it can make calculations harder and it is generally preferred 
to find two real- valued solutions. 

Here we can use Euler's formula. Let 

= ^iam- and y2 = e^"~'l^^-\ 

Then note that 

y\ = e"'' cosifix) + ie"'' smQ3x), 
y2 = e"'' cosifix) - ie""" sm{fix). 

Linear combinations of solutions are also solutions. Hence, 

3^1 +3^2 ax ro ^ 
J3 = — — = e cosifix), 

y4 = = e sm(J3x), 

2i 

are also solutions. Furthermore, they are real-valued. It is not hard to see that they are linearly 
independent (not multiples of each other). Therefore, we have the following theorem. 
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Theorem 2.2.3. Take the equation 

ay" + by' + cy = 0. 

If the characteristic equation has the roots a + ifi (when - Aac < 0), then the general solution is 

y = Cie"' cosOSx) + Cic"' sm(j3x). 

Example 2.2.2: Find the general solution of y" + k^y = 0, for a constant k > 0. 

The characteristic equation is r^ + k^ = 0. Therefore, the roots are r = +ik and by the theorem 
we have the general solution 

y = C\ cos(^x) + C2 sin(^x). 

Example 2.2.3: Find the solution of - 6y' + Uy = 0, y(0) = 0, y'(0) = 10. 

The characteristic equation is -6r+ 13 = 0. By completing the square we get (r - 3)^ + 2^ = 
and hence the roots are r = 3 + 2i. By the theorem we have the general solution 

y = Cie^'^cosCljc) + Cie^"^ sin(2jc). 

To find the solution satisfying the initial conditions, we first plug in zero to get 

= y(0) = Cie^ cos + Cae" sin = Ci . 

Hence Ci = and y = C2e^^ sin(2x). We differentiate 

/ = 3C2e^'- sin(2x) + 2C2e^^cos(2x). 

We again plug in the initial condition and obtain 10 = /(O) = 2C2, or C2 = 5. Hence the solution 
we are seeking is 

y = 5e^^ sin(2;c). 

2.2.3 Exercises 

Exercise 2.2.6; Find the general solution ofly" + 1y' - 4}; = 0. 
Exercise 2.2.7; Find the general solution ofy" + 9/ - lOy = 0. 
Exercise 2.2.8; Solve y" - %y' + I6y = Ofory(0) = 2, y'(0) = 0. 
Exercise 2.2.9; Solve y" + 9/ = Ofory(0) = 1, y'(0) = 1. 
Exercise 2.2.10; Find the general solution ofly" + 50y = 0. 
Exercise 2.2.11; Find the general solution ofy" + 6y' + 13j = 0. 
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Exercise 2.2.12; Find the general solution ofy" = using the methods of this section. 

Exercise 2.2.13; The method of this section applies to equations of other orders than two. We will 
see higher orders later Try to solve the first order equation 2y' + 3y = using the methods of this 
section. 

Exercise 2.2.14; Let us revisit Euler's equations of Exercise 2.L6 on page 50. Suppose now that 
(b - af' - 4ac < 0. Find a formula for the general solution ofax^y" + bxy' + cy = 0. Hint: Note 
that x' = 

Exercise 2.2.101; Find the general solution to y" + Ay' + 2y = 0. 

Exercise 2.2.102; Find the general solution to y" - 6y' + 9y = 0. 

Exercise 2.2.103; Find the solution to 2y" +y' +y = Q, y{Q) = \, y'{Q) = -2. 

Exercise 2.2.104; Find the solution to ly" + - 3y = 0, ^(0) = a, y'ifS) = b. 

Exercise 2.2.105; Find the solution to z"(t) = -2z'{t) - 2z{t), z(0) = 2, z'{0) = -2. 
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2.3 Higher order linear ODEs 

Note: somewhat more than 1 lecture, §3.2 and §3.3 in [EP], §4.1 and §4.2 in [BD] 

After reading this lecture, it may be good to try Project III from the lODE website: http : 
//www . math . uiuc . edu/iode/. 

Equations that appear in applications tend to be second order. Higher order equations do appear 
from time to time, but it is a general assumption of modem physics that the world is "second order." 

The basic results about linear ODEs of higher order are essentially the same as for second order 
equations, with 2 replaced by n. The important concept of linear independence is somewhat more 
complicated when more than two functions are involved. 

For higher order constant coefficient ODEs, the methods are also somewhat harder to apply, but 
we will not dwell on these complications. We can always use the methods for systems of linear 
equations from chapter 3 to solve higher order constant coefficient equations. 

So let us start with a general homogeneous linear equation 

+ p„-:{x)/"''^ + ■■■+ p,{x)y' + p^{x)y = 0. (2.4) 

Theorem 2.3.1 (Superposition). Suppose yi, yi, ■ ■ ■ , yn cire solutions of the homogeneous equation 
(2.4) . Then 

y{x) = Ciyiix) + C2y2(x) + ■■■ + C„j„(x) 

also solves (2.4) /or arbitrary constants C[, . . . , C„. 

In other words, a linear combination of solutions to (2.4) is also a solution to (2.4) . We also 
have the existence and uniqueness theorem for nonhomogeneous linear equations. 

Theorem 2.3.2 (Existence and uniqueness). Suppose po through Pn~\, and f are continuous func- 
tions on some interval I, a is a number in I, and bo,b[, . . . , b„-i are constants. The equation 

/"^ + pn-i(x)/"-'^ + ■■■+ py{x)y' + p^{x)y = fix) 

has exactly one solution y(x) defined on the same interval I satisfying the initial conditions 

y(a) = bo, y'(a) = bu /"-'\a) = b^-:. 

2.3.1 Linear independence 

When we had two functions yi and j2 we said they were linearly independent if one was not the 
multiple of the other. Same idea holds for n functions. In this case it is easier to state as follows. 
The functions yi,y2, ■ ■ ■ , yn are linearly independent if 

Ciyi + C2J2 + ■ • ■ + Cnyn = 

has only the trivial solution ci = C2 = ■ ■ ■ = c„ = 0, where the equation must hold for all x. If we can 
solve equation with some constants where for example ci 0, then we can solve for as a linear 
combination of the others. If the functions are not linearly independent, they are linearly dependent. 
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Example 2.3.1: Show that e^, e^^, e'^ are linearly independent. 

Let us give several ways to show this fact. Many textbooks (including [EPI and [F]) introduce 
Wronskians, but that is really not necessary here. 

Let us write down 

cie' + C2e^^ + c^e"" = 0. 
We use rules of exponentials and write z = e^. Then we have 

C\Z + C2Z^ + C3Z^ = 0. 

The left hand side is a third degree polynomial in z- It can either be identically zero, or it can have 
at most 3 zeros. Therefore, it is identically zero, ci = ci = C3 = 0, and the functions are linearly 
independent. 

Let us try another way. As before we write 

cie' + cie^'' + C3e^' = 0. 

This equation has to hold for all x. What we could do is divide through by e^^ to get 

cie"^"" + cie""' + C3 = 0. 

As the equation is true for all x, let x ^ 00. After taking the limit we see that C3 = 0. Hence our 
equation becomes 

cie'' + C2e^'' = 0. 

Rinse, repeat! 

How about yet another way. We again write 

cie'^ + €26^'' + c^e^'' = 0. 

We can evaluate the equation and its derivatives at different values of x to obtain equations for ci, 
C2, and C3. Let us first divide by for simplicity. 

ci + C2e'' + C3e^^ = 0. 

We set x = to get the equation c\ + C2 + C3 = 0. Now differentiate both sides 

C2e' + Ic^e^' = 0. 

We set X = to get C2 + 2c3 = 0. We divide by again and differentiate to get 2c3e''^ = 0. It is clear 
that C3 is zero. Then C2 must be zero as C2 = -2cs, and Ci must be zero because ci + C2 + C3 = 0. 
There is no one best way to do it. All of these methods are perfectly valid. 

Example 2.3.2: On the other hand, the functions e^, e'^, and cosh x are linearly dependent. Simply 
apply definition of the hyperbolic cosine: 

e'' + 

cosh X = — or 2 cosh x - e'' - = 0. 

2 
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2.3.2 Constant coefficient higher order ODEs 

When we have a higher order constant coefficient homogeneous linear equation, the song and dance 
is exactly the same as it was for second order. We just need to find more solutions. If the equation is 
order we need to find n linearly independent solutions. It is best seen by example. 

Example 2.3.3: Find the general solution to 

/" - 3/' -y' + 3y = 0. (2.5) 

Try: y = e". We plug in and get 

r^e" - 3r^e" - re" + 3e" = 0. 

We divide through by e" . Then 

P -3r^ -r + 3 = 0. 

The trick now is to find the roots. There is a formula for the roots of degree 3 and 4 polynomials but 
it is very complicated. There is no formula for higher degree polynomials. That does not mean that 
the roots do not exist. There are always n roots for an degree polynomial. They may be repeated 
and they may be complex. Computers are pretty good at finding roots approximately for reasonable 
size polynomials. 

A good place to start is to plot the polynomial and check where it is zero. We can also simply try 
plugging in. We just start plugging in numbers r = -2, -1, 0, 1, 2, . . . and see if we get a hit (we can 
also try complex numbers). Even if we do not get a hit, we may get an indication of where the root 
is. For example, we plug r = -2 into our polynomial and get -15; we plug in r = and get 3. That 
means there is a root between r = -2 and r = 0, because the sign changed. If we find one root, say 
ri, then we know (r - rO is a factor of our polynomial. Polynomial long division can then be used. 

A good strategy is to begin with r = -1, 1, or 0. These are easy to compute. Our polynomial 
happens to have two such roots, ri = -1 and r2 = 1. There should be 3 roots and the last root is 
reasonably easy to find. The constant term in a monic polynomial such as this is the multiple of the 
negations of all the roots because - 3r^ - r + 3 = (r - ri)(r - r2)(r - r^). So 

3 = {-n)(-r2){-r,) = (l)(-l)(-r3) = r,. 

You should check that rs = 3 really is a root. Hence we know that e~^, and e^^ are solutions 
to (2.5) . They are linearly independent as can easily be checked, and there are 3 of them, which 
happens to be exactly the number we need. Hence the general solution is 

y = Cie~' + Cze"-' + C3e^\ 

Suppose we were given some initial conditions y(0) = 1, y'(0) = 2, and y"(0) = 3. Then 

1 = yiO) = Ci + C2 + C3, 
2 = /(O) = -Ci + C2 + 3C3, 
3=/'(0) = Ci+C2 + 9C3. 
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It is possible to find the solution by high school algebra, but it would be a pain. The sensible way to 
solve a system of equations such as this is to use matrix algebra, see § 3.2. For now we note that the 
solution is Ci = -^4, C2 = 1, and C3 = V4- The specific solution to the ODE is 

-1 -V . 1 3v 

y=—e +e+- e . 
4 4 

Next, suppose that we have real roots, but they are repeated. Let us say we have a root r repeated 
k times. In the spirit of the second order solution, and for the same reasons, we have the solutions 

Q ^ ^ JC & ; • • • ; JC & t 

We take a linear combination of these solutions to find the general solution. 
Example 2.3.4: Solve 

y4)-3/" + 3/'- / =0. 
We note that the characteristic equation is 

/ - 3r^ + 3r2 - r = 0. 

By inspection we note that r'* - 3r^ + 3r^ - r = r{r -Xf . Hence the roots given with multiplicity 
are r = 0, 1, 1, 1. Thus the general solution is 

y = (Ci + C2X + Cjx^) e\ + ^C4^ . 

terms coming from r = 1 from r = 

The case of complex roots is similar to second order equations. Complex roots always come in 
pairs r = a+i/3. Suppose we have two such complex roots, each repeated k times. The corresponding 
solution is 

(Co + CiJC + • • • + C^^i/~i) e"'' cos(j3x) + (Do + D^x + ■ ■ ■ + D^-i/"') e"'' sm(J3x). 
where Co, ... , Ct^i, Dq, Dk-i are arbitrary constants. 
Example 2.3.5: Solve 

■yW _ 4y"' + 83;" _ 83;' + 43; = 0. 

The characteristic equation is 

/ - 4P + 8r2 - 8r + 4 = 0, 
(r^ -2r + T) = 0, 
((r-l)2 + lf = 0. 

Hence the roots are 1 + /, both with multiplicity 2. Hence the general solution to the ODE is 

y = (C\ + C2X) cos x + (C3 + C4X) sin x. 

The way we solved the characteristic equation above is really by guessing or by inspection. It is not 
so easy in general. We could also have asked a computer or an advanced calculator for the roots. 
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2.3.3 Exercises 

Exercise 2.3.1; Find the general solution for y'" - y" + y' - y = 0. 
Exercise 2.3.2; Find the general solution for y^"^^ - 5/" + 6y" = 0. 
Exercise 2.3.3; Find the general solution for y'" + ly" + ly' = 0. 

Exercise 2.3.4; Suppose the characteristic equation for a differential equation is (r - l)^(r - 2)^ = 
0. a) Find such a differential equation, b) Find its general solution. 

Exercise 2.3.5; Suppose that a fourth order equation has a solution y = le'^^xcos x. a) Find such 
an equation, b) Find the initial conditions that the given solution satisfies. 

Exercise 2.3.6; Find the general solution for the equation of Exercise 2.3.5. 

Exercise 2.3.7; Let f{x) = e^ - cos x, g{x) = e^ + cos x, and h{x) = cos x. Are f{x), g{x), and h(x) 
linearly independent? If so, show it, if not, find a linear combination that works. 

Exercise 2.3.8; Let f{x) = 0, g(x) = cos x, and h(x) = sin x. Are fix), g(x), and h(x) linearly 
independent? If so, show it, if not, find a linear combination that works. 

Exercise 2.3.9; Are x, x^, and x'^ linearly independent? If so, show it, if not, find a linear combina- 
tion that works. 

Exercise 2.3.10; Are e^, xe^, and x^e^ linearly independent? If so, show it, if not, find a linear 
combination that works. 

Exercise 2.3.101; Find the general solution ofy^^^ - y^^^ = 

Exercise 2.3.102; Suppose that the characteristic equation of a third order differential equation 
has roots 3,±2i. a) What is the characteristic equation? b) Find the corresponding differential 
equation, c) Find the general solution. 

Exercise 2.3.103; Solve lOOlj'" + 3.2y" + ny' - ^^4y = 0, y(0) = 0, /(O) = 0, /'(O) = 0. 

Exercise 2.3.104; Are e^, e^'^^, e^^, sin(x) linearly independent? If so, show it, if not find a linear 
combination that works. 

Exercise 2.3.105; Are sin(x), x, x?,m{x) linearly independent? If so, show it, if not find a linear 
combination that works. 
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2.4 Mechanical vibrations 

Note: 2 lectures, §3.4 in [BP], §3.7 in [BD] 

Let us look at some applications of linear second order constant coefficient equations. 

2.4.1 Some examples 

Our first example is a mass on a spring. Suppose we have 
a mass m > (in kilograms) connected by a spring with spring 
constant k > 0{m newtons per meter) to a fixed wall. There may be 
some external force F{t) (in newtons) acting on the mass. Finally, 
damping c there is some friction measured by c > (in newton- seconds per 

meter) as the mass slides along the floor (or perhaps there is a damper connected). 

Let X be the displacement of the mass (x = is the rest position), with x growing to the right 
(away from the wall). The force exerted by the spring is proportional to the compression of the 
spring by Hooke's law. Therefore, it is kx in the negative direction. Similarly the amount of force 
exerted by friction is proportional to the velocity of the mass. By Newton's second law we know 
that force equals mass times acceleration and hence mx" = F{t) - cx' - kx or 

mx" + cx + kx = F{t). 

This is a linear second order constant coefficient ODE. We set up some terminology about this 
equation. We say the motion is 

(i) forced, if F ^ (if F is not identically zero), 

(ii) unforced or free, if F = (if F is identically zero), 

(iii) damped, if c > 0, and 

(iv) undamped, if c = 0. 

This system appears in lots of applications even if it does not at first seem like it. Many real 
world scenarios can be simplified to a mass on a spring. For example, a bungee jump setup is 
essentially a mass and spring system (you are the mass). It would be good if someone did the math 
before you jump off" the bridge, right? Let us give two other examples. 

Here is an example for electrical engineers. Suppose that we have the 
pictured RLC circuit. There is a resistor with a resistance of R ohms, an 
inductor with an inductance of L henries, and a capacitor with a capacitance 
of C farads. There is also an electric source (such as a battery) giving a 
voltage of E(t) volts at time t (measured in seconds). Let Q(t) be the charge 
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in coulombs on the capacitor and I(t) be the current in the circuit. The relation between the two is 
Q' = I. By elementary principles we have that LI' + RI + Q/c = E. If we differentiate we get 

LI"(t)+Rr{t) + y{t) = E'(t). 

This is an nonhomogeneous second order constant coefficient linear equation. Further, as L, R, and 
C are all positive, this system behaves just like the mass and spring system. The position of the mass 
is replaced by the current. Mass is replaced by the inductance, damping is replaced by resistance 
and the spring constant is replaced by one over the capacitance. The change in voltage becomes the 
forcing function. Hence for constant voltage this is an unforced motion. 

Our next example behaves like a mass and spring system only approxi- 
mately. Suppose we have a mass m on a pendulum of length L. We wish to 
find an equation for the angle 6{t). Let g be the force of gravity. Elementary 
physics mandates that the equation is of the form 



6" 



+ - sine = 0. 
L 




This equation can be derived using Newton's second law; force equals mass times acceleration. 
The acceleration is L6" and mass is m. So mL9" has to be equal to the tangential component of the 
force given by the gravity. This is mg sin 6 in the opposite direction. The m curiously cancels from 
the equation. 

Now we make our approximation. For small 9 we have that approximately sin 6^6. This can 
be seen by looking at the graph. In Figure 2.1 we can see that for approximately -0.5 < 6 < 0.5 (in 
radians) the graphs of sin 6 and are almost the same. 




Figure 2.1: The graphs of sin 9 and 9 (in radians). 
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Therefore, when the swings are small, 6 is always small and we can model the behavior by the 
simpler linear equation 

0" + ^9 = 0. 

Note that the errors that we get from the approximation build up. So after a very long time, the 
behavior of the real system might be substantially different from our solution. Also we will see that 
in a mass-spring system, the amplitude is independent of the period. This is not true for a pendulum. 
Nevertheless, for reasonably short periods of time and small swings (for example if the pendulum is 
very long), the approximation is reasonably good. 

In real world problems it is very often necessary to make these types of simplifications. There- 
fore, it is good to understand both the mathematics and the physics of the situation to see if the 
simplification is valid in the context of the questions we are trying to answer. 

2.4.2 Free undamped motion 

In this section we will only consider free or unforced motion, as we cannot yet solve nonhomoge- 
neous equations. Let us start with undamped motion where c = 0. We have the equation 

mx" + kx = 0. 

If we divide by m and let (Oq = VV»»> then we can write the equation as 

x" + colx = 0. 

The general solution to this equation is 

x(t) = A cos(6t»oO + B sin((t>oO- 
By a trigonometric identity, we have that for two different constants C and 7, we have 

A cos((X»oO + B sin(tt>oO = C cos(6t»o? - 7). 

It is not hard to compute that C = Va^~-k6^ and tan 7 = ^/a. Therefore, we let C and 7 be our 
arbitrary constants and write x(t) = C cos(a>o^ - y)- 

Exercise 2.4.1; Justify the above identity and verify the equations for C and 7. Hint: Start with 
cos(a - p) = cos(Qr) cos(/8) -I- sin(Qr) sin(/S) and multiply by C. Then think what should a and be. 

While it is generally easier to use the first form with A and B to solve for the initial conditions, 
the second form is much more natural. The constants C and 7 have very nice interpretation. We 
look at the form of the solution 

x(t) = C cos(ajQt - 7). 
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We can see that the amplitude is C, (Oq is the (angular) frequency, and y is the so-called phase shift. 
The phase shift just shifts the graph left or right. We call 0*0 the natural (angular) frequency . This 
entire setup is usually called simple harmonic motion. 

Let us pause to explain the word angular before the word frequency. The units of coq are radians 
per unit time, not cycles per unit time as is the usual measure of frequency. Because we know one 
cycle is 2n radians, the usual frequency is given by It is simply a matter of where we put the 
constant 2n, and that is a matter of taste. 

The period of the motion is one over the frequency (in cycles per unit time) and hence ^. That 
is the amount of time it takes to complete one full oscillation. 

Example 2.4.1: Suppose that m = 2kg and k = S ^/m. The whole mass and spring setup is sitting 
on a truck that was traveling at 1 "/s. The truck crashes and hence stops. The mass was held in place 
0.5 meters forward from the rest position. During the crash the mass gets loose. That is, the mass is 
now moving forward at 1 "/s, while the other end of the spring is held in place. The mass therefore 
starts oscillating. What is the frequency of the resulting oscillation and what is the amplitude. The 
units are the mks units (meters-kilograms-seconds). 

The setup means that the mass was at half a meter in the positive direction during the crash and 
relative to the wall the spring is mounted to, the mass was moving forward (in the positive direction) 
at 1 nys. This gives us the initial conditions. 

So the equation with initial conditions is 

2x" + Sx = 0, x(0) = 0.5, x'{0) = 1. 

We can directly compute coq = VV^ = V4 = 2. Hence the angular frequency is 2. The usual 
frequency in Hertz (cycles per second) is yin = yn ^ 0.318. 
The general solution is 

x(t) = A cos(20 -I- B sin(20. 

Letting x(0) = 0.5 means A = 0.5. Then x'(t) = -2(0.5) sin(20 + 25cos(20. Letting x'(0) = 1 we 
get B = 0.5. Therefore, the amplitude is C = ^/A^ + B^ = VO.25 + 0.25 = VOS « 0.707. The 
solution is 

x(t) = 0.5 cos(20 + 0.5 sin(20. 
A plot of x(t) is shown in Figure 2.2 on the following page. 

In general, for free undamped motion, a solution of the form 

x(t) = A cos((t>oO + B sin(ct»oO> 

corresponds to the initial conditions x{0) = A and x'{0) = ojqB. Therefore, it is easy to figure out A 
and B from the initial conditions. The amplitude and the phase shift can then be computed from 
A and B. In the example, we have already found the amplitude C. Let us compute the phase shift. 
We know that tan 7 = ^/a = 1. We take the arctangent of 1 and get approximately 0.785. We still 
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0.0 2.5 5.0 7.5 10.0 




Figure 2.2: Simple undamped oscillation. 



need to check if this y is in the correct quadrant (and add ;r to y if it is not). Since both A and B are 
positive, then y should be in the first quadrant, and 0.785 radians really is in the first quadrant. 

Note: Many calculators and computer software do not only have the at an function for arctangent, 
but also what is sometimes called atan2. This function takes two arguments, B and A, and returns 
a y in the correct quadrant for you. 



2.4.3 Free damped motion 

Let us now focus on damped motion. Let us rewrite the equation 

mx" + cx + fcx = 0, 

as 

x" + 2px' + (x)qX = 0, 

where 

k c 



The characteristic equation is 



m 2m 



+ 2pr + a>o = 0. 



Using the quadratic formula we get that the roots are 



r = -p± ^P^ - col 



The form of the solution depends on whether we get complex or real roots. We get real roots if and 
only if the following number is nonnegative: 



\^ k — 4km 



2m I m Am^ 
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The sign of - col same as the sign of - 4km. Thus we get real roots if and only if - 4km 
is nonnegative, or in other words if > 4km. 



Overdamping 

When c^-4km > 0, we say the system is overdamped. In this case, there are two distinct real roots ri 
and r2. Notice that both roots are negative. As ^p'^ - co^ is always less than p, then -p + ^p^ - oj^ 
is negative. 

The solution is 

xit) = Cie'" + €26'^' . 

Since ri,r2 are negative, x{t) d& t ^ 00. 
Thus the mass will tend towards the rest position 
as time goes to infinity. For a few sample plots 
for diff"erent initial conditions, see Figure 2.3. 

Do note that no oscillation happens. In fact, 
the graph will cross the x axis at most once. To see 
why, we try to solve = C\e''^' ^Cje''^^' . Therefore, 
Cie*"'' = -Cje''^' and using laws of exponents we 
obtain 

-Ci 




C2 



Figure 2.3: Overdamped motion for several dif- 
ferent initial conditions. 



This equation has at most one solution t >0. For 
some initial conditions the graph will never cross the x axis, as is evident from the sample graphs. 

Example 2.4.2: Suppose the mass is released from rest. That is x(0) = Xq and x'{0) = 0. Then 

^0 r2t 



xit) = 



ri - r2 

It is not hard to see that this satisfies the initial conditions. 



Critical damping 

When - 4km = 0, we say the system is critically damped. In this case, there is one root of 
multiplicity 2 and this root is -p. Therefore, our solution is 

x(t) = Cie-P' + C2te-P'. 

The behavior of a critically damped system is very similar to an overdamped system. After all a 
critically damped system is in some sense a limit of overdamped systems. Since these equations 
are really only an approximation to the real world, in reality we are never critically damped, it is a 
place we can only reach in theory. We are always a little bit underdamped or a little bit overdamped. 
It is better not to dwell on critical damping. 
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Underdamping 

When - 4km < 0, we say the system is 
underdamped. In this case, the roots are complex. 



r=-p 



= -p+ V^^Jcol-p^ 
= -p + icoi, 

where coi = -^col - p^. Our solution is 



x(t) = e ^'(Acos(a»iO + 5sin(a;iO), 
x(t) = Ce"^'cos(cc»i? - y). 




or 



Figure 2.4: Underdamped motion with the en- 
velope curves shown. 



An example plot is given in Figure 2.4. Note that 
we still have that x(f) ^ as ? ^ oo. 

In the figure we also show the envelope curves Ce and -Ce ''^ The solution is the oscillating 
line between the two envelope curves. The envelope curves give the maximum amplitude of the 
oscillation at any given point in time. For example if you are bungee jumping, you are really 
interested in computing the envelope curve so that you do not hit the concrete with your head. 

The phase shift y just shifts the graph left or right but within the envelope curves (the envelope 
curves do not change if y changes). 

Finally note that the angular pseudo-frequency (we do not call it a frequency since the solution 
is not really a periodic function) a»i becomes smaller when the damping c (and hence p) becomes 
larger. This makes sense. When we change the damping just a little bit, we do not expect the 
behavior of the solution to change dramatically. If we keep making c larger, then at some point 
the solution should start looking like the solution for critical damping or overdamping, where no 
oscillation happens. So if c^ approaches Akm, we want ojx to approach 0. 

On the other hand when c becomes smaller, coy approaches coIq {pj\ is always smaller than a;o), 
and the solution looks more and more like the steady periodic motion of the undamped case. The 
envelope curves become flatter and flatter as c (and hence p) goes to 0. 



2.4.4 Exercises 

Exercise 2.4.2; Consider a mass and spring system with a mass m = 2, spring constant k = 3, and 
damping constant c = 1. a) Set up and find the general solution of the system, b) Is the system 
underdamped, overdamped or critically damped? c) If the system is not critically damped, find a c 
that makes the system critically damped. 
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Exercise 2.4.3; Do Exercise 2.4.2 for m = 3, k = 12, and c = 12. 

Exercise 2.4.4; Using the mks units (meters-kilograms-seconds), suppose you have a spring with 
spring constant 4 '^/m. You want to use it to weigh items. Assume no friction. You place the mass 
on the spring and put it in motion, a) You count and find that the frequency is 0.8 Hz (cycles per 
second). What is the mass? b) Find a formula for the mass m given the frequency co in Hz. 

Exercise 2.4.5; Suppose we add possible friction to Exercise 2.4.4. Further, suppose you do not 
know the spring constant, but you have two reference weights 1 kg and 2 kg to calibrate your setup. 
You put each in motion on your spring and measure the frequency. For the 1 kg weight you measured 
1.1 Hz, for the 2 kg weight you measured 0.8Hz. a) Find k (spring constant) and c (damping 
constant), b) Find a formula for the mass in terms of the frequency in Hz. Note that there may be 
more than one possible mass for a given frequency, c) For an unknown object you measured 0.2 Hz, 
what is the mass of the object? Suppose that you know that the mass of the unknown object is more 
than a kilogram. 

Exercise 2.4.6; Suppose you wish to measure the friction a mass of 0.1 kg experiences as it slides 
along a floor (you wish to find c). You have a spring with spring constant k = 5 ^/m. You take the 
spring, you attach it to the mass and fix it to a wall. Then you pull on the spring and let the mass go. 
You find that the mass oscillates with frequency 1 Hz. What is the friction? 

Exercise 2.4.101; A mass of 2 kilograms is on a spring with spring constant k newtons per meter 
with no damping. Suppose the system is at rest and at time t = the mass is kicked and starts 
traveling at 2 meters per second. How large does k have to be to so that the mass does not go 
further than 3 meters from the rest position? 

Exercise 2.4.102; Suppose we have an RLC circuit with a resistor of 100 miliohms (0.1 ohms), 
inductor of inductance of 50 millihenries (0.05 henries), and a capacitor of 5 farads, with constant 
voltage, a) Set up the ODE equation for the current Lb) Find the general solution, c) Solve for 
1(0) = 10 and L{0) = 0. 

Exercise 2.4.103; A 5000 kg railcar hits a bumper (a spring) at 1 and the spring compresses 
by 0.1 m. Assume no damping, a) Find k. b) Find out how far does the spring compress when a 
10000 kg railcar hits the spring at the same speed, c) If the spring would break if it compresses 
further than 0.3 m, what is the maximum mass of a railcar that can hit it at 1 "fs? d) What is the 
maximum mass of a railcar that can hit the spring without breaking at 2 "fs? 
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2.5 Nonhomogeneous equations 

Note: 2 lectures, §3.5 in [EPJ, §3.5 and §3.6 in [BDJ 
2.5.1 Solving nonhomogeneous equations 

We have solved linear constant coefficient homogeneous equations. What about nonhomogeneous 
linear ODEs? For example, the equations for forced mechanical vibrations. That is, suppose we 
have an equation such as 

y" + 5y' + 6y = 2x+l. (2.6) 

We will write Ly = 2x + I when the exact form of the operator is not important. We solve 
(2.6) in the following manner. First, we find the general solution yc to the associated homogeneous 
equation 

y" + 5/ + 63; = 0. (2.7) 

We call yc the complementary solution. Next, we find a single particular solution y^ to (2.6) in 
some way. Then 

y = yc + yp 

is the general solution to (2.6) . We have Ly^ = and Lyp = 2.x; + 1. As L is a linear operator we 
verify that y is a solution, Ly = Liy^ + yp) = Ly^ + Lyp = + {2x + 1). Let us see why we obtain the 
general solution. 

Let yp and yp be two different particular solutions to (2.6) . Write the difl'erence as w = yp - fp. 
Then plug w into the left hand side of the equation to get 

w" + 5w' + 6w = (y'; + 5y'p + 6yp) - iy'; + 5y'p + 6yp) = {2x + 1) - {2x + 1) = 0. 

Using the operator notation the calculation becomes simpler. As L is a linear operator we write 

Lw = L(yp - yp) = Lyp - Lyp = (2x + 1) - (2x + 1) = 0. 

So w = yp - yp is a solution to (2.7) , that is Lw = 0. Any two solutions of (2.6) differ by a solution 
to the homogeneous equation (2.7) . The solution y = yc + yp includes all solutions to (2.6) , since yc 
is the general solution to the associated homogeneous equation. 

Theorem 2.5.1. Let Ly = f(x) be a linear ODE (not necessarily constant coefficient). Let yc be the 
complementary solution (the general solution to the associated homogeneous equation Ly = Q) and 
let yp be any particular solution to Ly = f(x). Then the general solution to Ly = f{x) is 

y = yc + yp- 

The moral of the story is that we can find the particular solution in any old way. If we find a 
different particular solution (by a different method, or simply by guessing), then we still get the 
same general solution. The formula may look different, and the constants we will have to choose to 
satisfy the initial conditions may be different, but it is the same solution. 
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2.5.2 Undetermined coefficients 

The trick is to somehow, in a smart way, guess one particular solution to (2.6) . Note that 2x + 1 is a 
polynomial, and the left hand side of the equation will be a polynomial if we let y be a polynomial 
of the same degree. Let us try 

yp = Ax + B. 

We plug in to obtain 

y'p + 5y'p + 6yp = (Ax + B)" + 5{Ax + B)' + 6{Ax + 5) = + 5A + 6Ajc + 65 = 6Ax + (5A + 65). 

So 6Ax + (5A + 65) = 2x + 1. Therefore, A = 1/3 and B = -1/9. That means y^ = ^x- I = 
Solving the complementary problem (exercise!) we get 

y, = C,e-^' + C2e-'\ 

Hence the general solution to (2.6) is 

y = C,e-^'' + C2e-''+^^. 



Now suppose we are further given some initial conditions. For example, y(0) = and y'iO) = V3. 
First find / = -2Cie'^' - SCze"^' + V3. Then 

= y(0) = Ci + C2 - ^, ^ = /(O) = -2Ci - 3C2 + ^. 

We solve to get Ci = V3 and C2 = ~y9. The particular solution we want is 

1 .2. 2 3jc-1 3e'2^ - 2e-3'^ + 3jc - 1 

y(x) = -e - -e + — - — = . 

■^^ 3 9 9 9 

Exercise 2.5.1; Check thaty really solves the equation (2.6) and the given initial conditions. 

Note: A common mistake is to solve for constants using the initial conditions with yc and only 
add the particular solution yp after that. That will not work. You need to first compute y = yc + yp 
and only then solve for the constants using the initial conditions. 

A right hand side consisting of exponentials, sines, and cosines can be handled similarly. For 
example, 

y" + ly' + ly = cos(2x). 

Let us find some yp. We start by guessing the solution includes some multiple of cos(2jc). We may 
have to also add a multiple of sin(2jc) to our guess since derivatives of cosine are sines. We try 

yp = A cos(2x) + B sin(2x). 
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We plug yp into the equation and we get 

-4A cos(2x) - 45 sin(2x) - 4A sin(2x) + 45 cos(2x) + 2A cos(2x) + 25 sin(2x) = cos(2x). 

The left hand side must equal to right hand side. We group terms and we get that -4A + 45 + 2A = 1 
and -45 - 4A + 25 = 0. So -2A + 45 = 1 and 2A + 5 = and hence A = -i/io and 5 = Vs. So 

A ^ , D ■ ^ -cos(2x) + 2sin(2j:) 
yp = Acos(2x) + 5sm(2x) = — . 

Similarly, if the right hand side contains exponentials we try exponentials. For example, for 



we will try y = Ae^^ as our guess and try to solve for A. 

When the right hand side is a multiple of sines, cosines, exponentials, and polynomials, we can 
use the product rule for differentiation to come up with a guess. We need to guess a form for yp such 
that Lyp is of the same form, and has all the terms needed to for the right hand side. For example, 

Ly = (l+ 3x^) e'"" cos(7rx). 

For this equation, we will guess 

yp = (A + Bx + Cx^) e"-" cos(7rx) + (D + Ex + Fx^) e'"" sin(7rx). 

We will plug in and then hopefully get equations that we can solve for A, 5, C, D, E, and F. As you 
can see this can make for a very long and tedious calculation very quickly. C'est la vie! 

There is one hiccup in all this. It could be that our guess actually solves the associated 
homogeneous equation. That is, suppose we have 

y" -9y = 

We would love to guess y = Ae^^, but if we plug this into the left hand side of the equation we get 

y" -9y = 9Ae^^ - 9Ae^^ = i= 

There is no way we can choose A to make the left hand side be e^^. The trick in this case is to 
multiply our guess by x to get rid of duplication with the complementary solution. That is first we 
compute yc (solution to Ly = 0) 

and we note that the e^^ term is a duplicate with our desired guess. We modify our guess to 
y = Axe^^ and notice there is no duplication anymore. Let us try. Note that y' = Ae^^ + 3Axe^^ and 
/' = 6Ae3^ + 9Axe^\ So 

y" -9y = GAe^"" + 9Axe^'' - 9Ajce^^ = 6Ae^\ 



2.5. NONHOMOGENEOUS EQUATIONS 



73 



Thus 6Ae^^ is supposed to equal e^^. Hence, 6A = 1 and so A = Vs. We can now write the general 
solution as ^ 

y = yc + yp = Cie'^"" + Cte^'' + - xe^\ 

It is possible that multiplying by x does not get rid of all duplication. For example, 

y" - 6y' + 9y = 

The complementary solution is y^ = Cie^^ + €2X6^^. Guessing y = Axe^^ would not get us anywhere. 
In this case we want to guess yp = Ax^e^^. Basically, we want to multiply our guess by x until all 
duplication is gone. But no more! Multiplying too many times will not work. 

Finally, what if the right hand side has several terms, such as 

Ly = e^^ + cos jc. 

In this case we find u that solves Lu = e^^ and v that solves Lv = cos x (that is, do each term 
separately). Then note that if 3; = m + v, then Ly = e^^ + cos x. This is because L is linear; we have 
Ly = L(u + v) = Lu + Lv = e^^ + cos x. 

2.5.3 Variation of parameters 

The method of undetermined coefficients will work for many basic problems that crop up. But it 
does not work all the time. It only works when the right hand side of the equation Ly = f(x) has 
only finitely many linearly independent derivatives, so that we can write a guess that consists of 
them all. Some equations are a bit tougher. Consider 

y" + y = tan x. 

Note that each new derivative of tan x looks completely different and cannot be written as a linear 
combination of the previous derivatives. We get sec^ x, 2 sec^ x tan x, etc 

This equation calls for a different method. We present the method of variation of parameters, 
which will handle any equation of the form Ly = f(x), provided we can solve certain integrals. 
For simplicity, we restrict ourselves to second order constant coefficient equations, but the method 
works for higher order equations just as well (the computations become more tedious). The method 
also works for equations with nonconstant coefficients, provided we can solve the associated 
homogeneous equation. 

Perhaps it is best to explain this method by example. Let us try to solve the equation 

Ly = y" + y = tan x. 

First we find the complementary solution (solution to Lyc = 0). We get y^ = Ciyi + C2y2, where 
yi = cos X and 3^2 = sin x. To find a particular solution to the nonhomogeneous equation we try 



yp=y = uiyi + U2y2, 
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where u\ and U2 are functions and not constants. We are trying to satisfy Ly = taax. That gives us 
one condition on the functions mi and U2. Compute (note the product rule!) 

/ = (u[yi + u'^yi) + + M2y2)- 

We can still impose one more condition at our discretion to simplify computations (we have two 
unknown functions, so we should be allowed two conditions). We require that {u\y\ + u^yi) = 0. 
This makes computing the second derivative easier. 

/ = uiy\ + 

y" = (u[y[ + M^2) + ("ij" + "2J2 )• 

Since yi and y2 are solutions to y" + y = 0, we know that = -yi and = -yi- (Note: If the 
equation was instead /' + p(x)y' + q(x)y = we would have y-' = -p(x)yf - q(x)yi.) So 

y" = (u[y[ + M^y2) - (miJi + M2J2). 

We have (uiyi + U2y2) = y and so 

/' = (w'1/1 +M^2)->'' 

and hence 

y" +y = Ly = u[y[ + u'2y2. 

For y to satisfy Ly = f(x) we must have f(x) = u[y[ + u'^\. 

So what we need to solve are the two equations (conditions) we imposed on u\ and U2 

m'iJi + \^!^y2 = 0, 
"iJl + "23^2 = /(^)- 

We can now solve for u\ and in terms of f{x), y\ and j2- We will always get these formulas for 
any Ly = f(x), where Ly = y" + p(x)y' + q(x)y. There is a general formula for the solution we can 
just plug into, but it is better to just repeat what we do below. In our case the two equations become 

u[ cos(;c) + u'2 sin(x) = 0, 
-u\ sm(x) + u'2 cos(x) = tan(jc). 

Hence 

u[ cos(x) sin(x) + u'2 sin^(x) = 0, 
-Mj sin(x) cos(x) + u'2 cos^(x) = tan(x) cos(x) = sm(x). 
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And thus 



M2(sin^(x) + cos^(x)) = sin(jc), 
M2 = sin(x), 



M, = 



-sin (x) 
cos(x) 



= - tan(jc) sin(jc). 



tan(x) sin(jc) dx = - In 



Now we need to integrate u[ and to get ui and M2. 

Ml = J' u\ dx = ^ - 
U2 = u'2dx = sin(x) dx = - cos(x) 
So our particular solution is 



sm(x) - 1 



sin(x) + 1 



+ sin(jc). 



yp = uiyi + U2y2 = 2 cos(x)ln 



sin(jc) - 1 



sin(x) + 1 



+ cos(x) sin(x) - cos(x) sin(jc) = 



= i cos(x) In 



sin(x) - 1 



sin(x) + 1 



The general solution to y" + y = tan x is, therefore, 

y = Ci cos(x) + C2 sin(x) + ^ cos(x) In 



sm(x) - 1 



sin(;c) + 1 



2.5.4 Exercises 

Exercise 2.5.2: Find a particular solution ofy" -y' - 6y = e^^. 
Exercise 2.5.3; Find a particular solution ofy" - Ay' + Ay = e^^. 

Exercise 2.5.4; Solve the initial value problem y" + = cos(3x) + sin(3x)/or 3;(0) = 2, /(O) = 1. 
Exercise 2.5.5; Setup the form of the particular solution hut do not solve for the coefficients for 

3;(4) _ 2y"' + y" = e\ 

Exercise 2.5.6; Setup the form of the particular solution hut do not solve for the coefficients for 

_ 2y"' + _y" = + jj; + gin X 

Exercise 2.5.7; a) Using variation of parameters find a particular solution ofy" -2y' + y = e^. b) 
Find a particular solution using undetermined coefficients, c) Are the two solutions you found the 
same? What is going on? 
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Exercise 2.5.8; Find a particular solution ofy" - 2y' + y = sin(x^). It is OK to leave the answer as 
a definite integral. 

Exercise 2.5.9; For an arbitrary constant cfind a particular solution to y" - y = e'^^. Hint: Make 
sure to handle every possible real c. 

Exercise 2.5.101; Find a particular solution toy" - y' + y = 2 sin(3x) 

Exercise 2.5.102; a) Find a particular solution to y" +2y = e"" + x^. b) Find the general solution. 
Exercise 2.5.103; Solve y" + 2/ + y = x^, ^(O) = 1, /(O) = 2. 

Exercise 2.5.104; Use variation of parameters to find a particular solution ofy" - y = ^xl^^x - 
Exercise 2.5.105; For an arbitrary constant cfind the general solution to y" -2y = sin(x + c). 
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2.6 Forced oscillations and resonance 

Note: 2 lectures, §3.6 in [EP], §3.8 in [BD] 

Let us return back to the example of a mass on a spring. We 
now examine the case of forced oscillations, which we did not yet 
handle. That is, we consider the equation 

mx" + cx' + kx = F{t), 

for some nonzero F{t). The setup is again: m is mass, c is friction, k is the spring constant and F{t) 
is an external force acting on the mass. 

What we are interested in is periodic forcing, such as noncentered rotating parts, or perhaps 
loud sounds, or other sources of periodic force. Once we learn about Fourier series in chapter 4, 
we will see that we cover all periodic functions by simply considering F{t) = Fq cosiojt) (or sine 
instead of cosine, the calculations are essentially the same). 

2.6.1 Undamped forced motion and resonance 

First let us consider undamped (c = 0) motion for simplicity. We have the equation 

mx" + kx = Fq cos(a)t). 

This equation has the complementary solution (solution to the associated homogeneous equation) 

Xc = Ci cos{coot) + C2 sin(a»oO. 

where coq = VV™ is the natural frequency (angular). It is the frequency at which the system "wants 
to oscillate" without external interference. 

Let us suppose that coo 4^ co. We try the solution Xp = A cos(a»f) and solve for A. Note that we 
need not have sine in our trial solution as on the left hand side we will only get cosines anyway. If 
you include a sine it is fine; you will find that its coefficient will be zero (I could not find a rhyme). 

We solve using the method of undetermined coefficients. We find that 

= cosiojt). 

m(a»Q - o)"^) 

We leave it as an exercise to do the algebra required. 
The general solution is 



X = Ci cos(coot) + C2 sin(a»oO + ^ cos(a)t). 

m(a)i - ur) 




damping c 
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or written another way 



X = C cos{a)ot -y) + 



cos(ajt). 



Hence it is a superposition of two cosine waves at different frequencies. 
Example 2.6.1: Take 

0.5jc" + Sx= 10cos(nt), x{0) = 0, x'(0) = 0. 

Let us compute. First we read off the parameters: co = n, too = Wo-s = 4, Fq = 10, m = 0.5. 
The general solution is 



x = Ci cos(40 + C2 sin(40 + 



20 



16-7r2 



cos(7r0. 



-20 



Solve for Ci and C2 using the initial conditions. It is easy to see that Ci - 
Hence 

20 

X = — ;-(cos(7rO - cos(40)- 



and C2 = 0. 



16-7r2 




Notice the "beating" behavior in Figure 2.5. 
First use the trigonometric identity 

^ . /A-B\ . (A + B\ 
2 sm — - — sm — - — = cos B - cos A 



to get that 



20 



16 -n^ 



^ ■ ,4-:t \ . (4 + 7T \ 
2 sm — - — t\ sm — - — t 



Notice that xis a high frequency wave modulated 
by a low frequency wave. 

Now suppose that ojq = co. Obviously, we 
Figure 2.5: Graph of Y^(cos(nt) - cos(40). cannot try the solution A cos{ojt) and then use the 

method of undetermined coefficients. We notice 
that cos(a)0 solves the associated homogeneous equation. Therefore, we need to try Xp = At cos(a>t)+ 
Btsm{(x>t). This time we do need the sine term since the second derivative of tcos{a)t) does contain 
sines. We write the equation 

x" + a?x = — cos{a)t). 
m 

Plugging Xp into the left hand side we get 



2B(ocos(a)t) - 2Aa) sm(a)t) = — cos(a)t). 

m 
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Hence A = and B = j-^. Our particular solution is j-^ t sin(cL>0 and our general solution is 



X = Ci cos(a;f) + C2 sm{a)t) + 



2mto 



ts'm{a)t). 



The important term is the last one (the particular solution we found). We can see that this term 
grows without bound as ? ^ 00. In fact it oscillates between and The first two terms only 

oscillate between + + Cf, which becomes smaller and smaller in proportion to the oscillations 
of the last term as t gets larger. In Figure 2.6 we see the graph with Ci = C2 = 0, Fq = 2, m = 1, 

CO = 7T. 

By forcing the system in just the right fre- 
quency we produce very wild oscillations. This 
kind of behavior is called resonance or perhaps 
pure resonance. Sometimes resonance is desired. 
For example, remember when as a kid you could 
start swinging by just moving back and forth on 
the swing seat in the "correct frequency"? You 
were trying to achieve resonance. The force of 
each one of your moves was small, but after a 
while it produced large swings. 

On the other hand resonance can be destruc- 
tive. In an earthquake some buildings collapse 
while others may be relatively undamaged. This 
is due to diff'erent buildings having different reso- 
nance frequencies. So figuring out the resonance 
frequency can be very important. 

A common (but wrong) example of destructive force of resonance is the Tacoma Narrows bridge 
failure. It turns out there was a diff"erent phenomenon at play*. 

2.6.2 Damped forced motion and practical resonance 

In real life things are not as simple as they were above. There is, of course, some damping. Our 
equation becomes 

mx" + cx + kx = Fo cos{cot), (2.8) 
for some c > 0. We have solved the homogeneous problem before. We let 




Figure 2.6: Graph of hsm{nt). 



^ 2m 



*K. Billah and R. Scanlan, Resonance, Tacoma Narrows Bridge Failure, and Undergraduate Physics Textbooks, 
American Journal of Physics, 59(2), 1991, 118-124, http://www.ketchum.org/billah/Billah-Scanlan.pdf 
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We replace equation (2.8) with 



x" + Ipx + col,x = — cos{ojt). 

m 

The roots of the characteristic equation of the associated homogeneous problem are ri,r2 = 
-p + yjp^ - oJq. The form of the general solution of the associated homogeneous equation depends 
on the sign of p^ - oJq, or equivalently on the sign of - 4km, as we have seen before. That is, 

'Cie'^' + C2e''^' ifc^>4km, 
Cie-P' + C2te-P' ifc^ = 4-km, 

e~P'(Ci cos(a)it) + C2 sin(a»iO) if < 4km , 



Xr = < 



where oji = -^oj^ - p^. In any case, we can see that x^ (t) as t ^ 00. Furthermore, there can 
be no conflicts when trying to solve for the undetermined coefficients by trying Xp = A cos(a»0 + 
B s'm(cot). Let us plug in and solve for A and B. We get (the tedious details are left to reader) 

((a»o - o/)B - lojpA) s'm{a>t) + {(tol - o/)A + lojpB) cos(a)0 = — cos(ojt). 

m 



We get that 



B 

We also compute C = VA^ + B^ to be 

C = 

Thus our particular solution is 



m(2cop)^ + m(a)Q - co^f' 
IcopFo 

m(2a)p)^ + m{oji - ap-^ 



m 



yli2ojpf + C 



coi. - co^) 



Xp 



{col ~ '^^)Po 



cos(a»f) + 



liOppQ 



m(2a)p)^ + m(a)l - Cxp-'f m(2a)p)^ + m((ol - (x)^~f 



sin(a»0- 



Or in the alternative notation we have amplitude C and phase shift y where (if u) Wq) 

B 2a>p 
tan 7 = - = — 
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Hence we have 



yjilcopf + (col - co^y 



: cos(a)t - y). 



m 



If CO = coq we see that A = 0, B = C 



Fq 
2ma/p 



and y = "li. 



The exact formula is not as important as the idea. Do not memorize the above formula, you 
should instead remember the ideas involved. For different forcing function F, you will get a different 
formula for Xp. So there is no point in memorizing this specific formula. You can always recompute 
it later or look it up if you really need it. 

For reasons we will explain in a moment, we call Xc the transient solution and denote it by 
Xtr. We call the Xp we found above the steady periodic solution and denote it by x^p. The general 
solution to our problem is 



sp- 



We note that Xc = Xtr goes to zero as ? ^ cx), 
as all the terms involve an exponential with a 
negative exponent. Hence for large t, the effect 
of Xtr is negligible and we will essentially only 
Hence the name transient. Notice that 



see X 




sp- 

Xsp involves no arbitrary constants, and the initial 
conditions will only affect Xtr- This means that 
the effect of the initial conditions will be negli- 
gible after some period of time. Because of this 
behavior, we might as well focus on the steady 
periodic solution and ignore the transient solu- 
tion. See Figure 2.7 for a graph of different initial 
conditions. 

Notice that the speed at which Xt,- goes to zero 
depends on p (and hence c). The bigger p is (the 
bigger c is), the "faster" Xtr becomes negligible. 
So the smaller the damping, the longer the "tran- 
sient region." This agrees with the observation 

that when c = 0, the initial conditions affect the behavior for all time (i.e. an infinite "transient 
region"). 

Let us describe what we mean by resonance when damping is present. Since there were no 
conflicts when solving with undetermined coefficient, there is no term that goes to infinity. What we 
will look at however is the maximum value of the amplitude of the steady periodic solution. Let C 
be the amplitude of x^p. If we plot C as a function of to (with all other parameters fixed) we can find 
its maximum. We call the co that achieves this maximum the practical resonance frequency. We call 
the maximal amplitude C{to) the practical resonance amplitude. Thus when damping is present we 



Figure 2.7: Solutions with different initial con- 
ditions for parameters ^=l,m=l, Fo = l, 
c = 0.7, and to = 1.1. 
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talk of practical resonance rather than pure resonance. A sample plot for three different values of c 
is given in Figure 2.8. As you can see the practical resonance amplitude grows as damping gets 
smaller, and any practical resonance can disappear when damping is large. 




0.0 0.5 1.0 1.5 2.0 2.5 3.0 



Figure 2.8: Graph of C{(jo) showing practical resonance with parameters k = l,m = I, Fq = 1. The 
top hne is with c = 0.4, the middle line with c = 0.8, and the bottom line with c = 1.6. 



To find the maximum we need to find the derivative C'(a)). Computation shows 

Cico) = '-^ 

m{{2copf + {col - 

This is zero either when co = or when 2p^ + o/ - col = 0. other words, C'(a>) = when 




or 0) = 0. 



It can be shown that if col ~ '^P^ positive, then yojQ - 2p'^ is the practical resonance frequency 
(that is the point where C{a)) is maximal, note that in this case C'(a») > for small a»). If a» = is 
the maximum, then essentially there is no practical resonance since we assume that > in our 
system. In this case the amplitude gets larger as the forcing frequency gets smaller. 

If practical resonance occurs, the frequency is smaller than a»o. As the damping c (and hence p) 
becomes smaller, the practical resonance frequency goes to coq. So when damping is very small, ooq, 
is a good estimate of the resonance frequency. This behavior agrees with the observation that when 
c = 0, then coo is the resonance frequency. 

The behavior is more complicated if the forcing function is not an exact cosine wave, but for 
example a square wave. It will be good to come back to this section once we have learned about the 
Fourier series. 
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2.6.3 Exercises 

Exercise 2.6.1; Derive a formula for x^p if the equation is mx" + cx' + kx = Fq sm(a)t). Assume 
c> 0. 

Exercise 2.6.2: Derive a formula for x^p if the equation is mx" +cx' +kx = Fq cos(a»0 cos(3a)t). 
Assume c > 0. 

Exercise 2.6.3; Take mx" + cx' + kx = Fq cos(ajt). Fix m > and k > 0. Now think of the function 
C(aj). For what values ofc (solve in terms ofm, k, and Fq) will there be no practical resonance 
(that is, for what values ofc is there no maximum ofC(a>)for oj > 0)? 

Exercise 2.6.4; Take mx" + cx' + kx = Fq cos(ojt). Fix c> and k> 0. Now think of the function 
C{(jj). For what values ofm (solve in terms ofc, k, and Fq) will there be no practical resonance 
( that is, for what values ofm is there no maximum ofC(a>)for a> > 0)? 

Exercise 2.6.5; Suppose a water tower in an earthquake acts as a mass-spring system. Assume 
that the container on top is full and the water does not move around. The container then acts as a 

mass and the support acts as the spring, where the induced vibrations are horizontal. Suppose that 
the container with water has a mass ofm = 10, 000 kg. It takes a force of 1000 newtons to displace 
the container 1 meter. For simplicity assume no friction. When the earthquake hits the water tower 
is at rest (it is not moving). 

Suppose that an earthquake induces an external force F(t) = mAa/ cosicot). 

a) What is the natural frequency of the water tower? 

b) Ifco is not the natural frequency, find a formula for the maximal amplitude of the resulting 
oscillations of the water container (the maximal deviation from the rest position). The motion will 
be a high frequency wave modulated by a low frequency wave, so simply find the constant in front 
of the sines. 

c) Suppose A = 1 and an earthquake with frequency 0.5 cycles per second comes. What is the 
amplitude of the oscillations? Suppose that if the water tower moves more than 1.5 meter, the tower 
collapses. Will the tower collapse? 

Exercise 2.6.101; A mass of 4 kg on a spring with k = 4 and a damping constant c = I. Suppose 
that Fo = 2. Using forcing of Fq cos(a>0- Find the a> that causes practical resonance and find the 
amplitude. 

Exercise 2.6.102; Derive a formula for x^pfor mx!' cx! +kx = Fq cos(6;0 + A where A is some 
constant. Assume c > 0. 

Exercise 2.6.103; Suppose there is no damping in a mass and spring system with m = 5, k = 20, 
and Fq = 5. Suppose that cd is chosen to be precisely the resonance frequency, a) Find io. b) Find 
the amplitude of the oscillations at time t = 100. 
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Chapter 3 
Systems of ODEs 



3.1 Introduction to systems of ODEs 

Note: 1 lecture, §4.1 in [EPJ, §7.1 in [BD] 

Often we do not have just one dependent variable and one equation. And as we will see, we 
may end up with systems of several equations and several dependent variables even if we start with 
a single equation. 

If we have several dependent variables, suppose yi,y2, ■ ■ ■ , yn, then we can have a differential 
equation involving all of them and their derivatives. For example, y" = f(y[,y2,yi,y2, x). Usually, 
when we have two dependent variables we have two equations such as 

// = fi(y'i,y2'yi,y2,x), 
y2 = f2iy\,y'2^y\,y2,x), 

for some functions f\ and /2. We call the above a system of differential equations. More precisely, 
the above is a second order system of ODEs. 

Example 3.1.1: Sometimes a system is easy to solve by solving for one variable and then for the 
second variable. Take the first order system 

y[ =yi, 
y'2 =yi -y2, 

with initial conditions of the form yi(0) = 1, j2(0) = 2. 

We note that yi = Cie^ is the general solution of the first equation. We then plug this yi into the 
second equation and get the equation y2 = Cie^ -y2, which is a linear first order equation that is 
easily solved for 3^2 ■ By the method of integrating factor we get 

e^y2 = ye'" + C2, 
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or y2 = -^e^ + €26 ^. The general solution to the system is, therefore, 

yi = C,e\ 

y, = ^e^ + C2e-\ 

We now solve for Ci and C2 given the initial conditions. We substitute x = and find that Ci = 1 
and C2 = V2- Thus the solution is yi = e^, and y2 = (^/2)e^ + {^2)6^^. 

Generally, we will not be so lucky to be able to solve for each variable separately as in the 
example above, and we will have to solve for all variables at once. 

]^ As an example application, let us think of mass and spring 

systems again. Suppose we have one spring with constant k, but 
two masses mi and m2. We can think of the masses as carts, 
^ I ^> ^ I ^> and we will suppose that they ride along a straight track with no 

^1 friction. Let xi be the displacement of the first cart and X2 be the 

displacement of the second cart. That is, we put the two carts somewhere with no tension on the 
spring, and we mark the position of the first and second cart and call those the zero positions. Then 
xi measures how far the first cart is from its zero position, and X2 measures how far the second cart 
is from its zero position. The force exerted by the spring on the first cart is k(x2 - xi), since X2 - xi 
is how far the string is stretched (or compressed) from the rest position. The force exerted on the 
second cart is the opposite, thus the same thing with a negative sign. Newton's second law states 
that force equals mass times acceleration. So the system of equations governing the setup is 

mix" = k(x2 - xi), 
m2X2 = -k(x2 - Xi). 

In this system we cannot solve for the xi or X2 variable separately. That we must solve for both 
xi and X2 at once is intuitively clear, since where the first cart goes depends exactly on where the 
second cart goes and vice-versa. 

Before we talk about how to handle systems, let us note that in some sense we need only consider 
first order systems. Let us take an order difl'erential equation 

/"> = F(y^"-'\...,y,y,x). 

We define new variables and write the system 

u\ = U2, 
u'2 = M3> 

= Ufi, 

= F(l^n, Un-\, . . . ,U2, Ui,x). 
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We solve this system for ui,U2, . . . , Un- Once we have solved for the m's, we can discard U2 through 
Un and let y = u^. We note that this y solves the original equation. 

A similar process can be followed for a system of higher order differential equations. For 
example, a system of k differential equations in k unknowns, all of order n, can be transformed into 
a first order system of n x ^ equations and nxk unknowns. 

Example 3.1.2: Sometimes we can use this idea in reverse as well. Let us take the system 

x' =2y - X, y' = x, 

where the independent variable is t. We wish to solve for the initial conditions x(0) = 1, y(0) = 0. 

If we differentiate the second equation we get y" = x' . We know what x' is in terms of x and y, 
and we know that x = /. 

y" = x = 2y - X = 2y - y' . 

We now have the equation y" -vy' -ly = We know how to solve this equation and we find that 
y = C\e~^^ + C^eK Once we have y we use the equation y' = xio get jc. 

X = / = -2Cie-^' + Cj,e\ 

We solve for the initial conditions 1 = xi^S) = -1C\ + C2 and = _y(0) = Ci + C2. Hence, C\ = -C2 
and 1 = 3C2. So C\ = -1/3 and C2 = Vs. Our solution is 

x = ^^, y = ^^- 

Exercise 3.1.1; Plug in and check that this really is the solution. 

It is useful to go back and forth between systems and higher order equations for other reasons. 
For example, the ODE approximation methods are generally only given as solutions for first order 
systems. It is not very hard to adapt the code for the Euler method for first order equations to handle 
first order systems. We essentially just treat the dependent variable not as a number but as a vector. 
In many mathematical computer languages there is almost no distinction in syntax. 

In fact, this is what lODE was doing when you had it solve a second order equation numerically 
in the lODE Project in if you have done that project. 

The above example is what we call a linear first order system, as none of the dependent variables 
appear in any functions or with any higher powers than one. It is also autonomous as the equations 
do not depend on the independent variable t. 

For autonomous systems we can easily draw the so-called direction field or vector field. That is, 
a plot similar to a slope field, but instead of giving a slope at each point, we give a direction (and a 
magnitude). The previous example =2y - x,y' = x says that at the point {x, y) the direction in 
which we should travel to satisfy the equations should be the direction of the vector (2y - x, x) with 
the speed equal to the magnitude of this vector. So we draw the vector {2y - x, x) based at the point 
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(x, y) and we do this for many points on the xy-plane. We may want to scale down the size of our 
vectors to fit many of them on the same direction field. See Figure 3.1. 

We can now draw a path of the solution in the plane. That is, suppose the solution is given by 
X = f{t), y = g{t), then we can pick an interval of t (say < f < 2 for our example) and plot all 
the points {f{t), g{t)) for t in the selected range. The resulting picture is usually called the phase 
portrait (or phase plane portrait). The particular curve obtained we call the trajectory or solution 
curve. An example plot is given in Figure 3.2. In this figure the line starts at (1,0) and travels along 
the vector field for a distance of 2 units of t. Since we solved this system precisely we can compute 
x{2) and y(2). We get that x{2) » 2.475 and ^(2) « 2.457. This point corresponds to the top right 
end of the plotted solution curve in the figure. 




Figure 3.1: The direction field for x' = 2y - x. Figure 3.2: The direction field for x' = 2y - x, 
y' = X. y' = X with the trajectory of the solution starting 

at(l,0)for0<f<2. 



Notice the similarity to the diagrams we drew for autonomous systems in one dimension. But 
now note how much more complicated things become if we allow just one more dimension. 

Also note that we can draw phase portraits and trajectories in the xy-plane even if the system is 
not autonomous. In this case however we cannot draw the direction field, since the field changes as 
t changes. For each t we would get a different direction field. 

3.1.1 Exercises 

Exercise 3.1.2; Find the general solution ofx[ = X2 - xi + t, x'j = X2. 
Exercise 3.1.3; Find the general solution ofx\ = 3xi - X2 + e', x\ = Xi. 
Exercise 3.1.4; Write ay" + by' + cy = f(x) as a first order system ofODEs. 
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Exercise 3.1.5; Write x" +y^y' -x^ = sin(0, y" + (x' + y')^ -x = Oas a first order system ofODEs. 

Exercise 3.1.101; Find the general solution to y'j = 3yi, y'2=yi + yi, 3^3 = + y^- 

Exercise 3.1.102; Solve y' = 2x, x' = x + y, x(0) = 1, y(0) = 3. 

Exercise 3.1.103; Write x'" = x + t as a first order system. 

Exercise 3.1.104; Write y" +yi +y2 = t, y'2 + yi - y2 = as a first order system. 
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3.2 Matrices and linear systems 

Note: 1 and a half lectures, first part of §5.1 in [EPJ, §7.2 and §7.3 in [BP] 



3.2.1 Matrices and vectors 

Before we can start talking about linear systems of ODEs, we will need to talk about matrices, so 
let us review these briefly. A matrix is an m x n array of numbers (m rows and n columns). For 
example, we denote a 3 x 5 matrix as follows 



ail ^12 ^^13 ^14 ^15 
a2l a22 «23 (^24 ^^25 
a^i ^32 ^33 a34 a35 



By a vector we will usually mean a column vector, that is an m x 1 matrix. If we mean a row 
vector we will explicitly say so (a row vector is a 1 x n matrix). We will usually denote matrices by 
upper case letters and vectors by lower case letters with an arrow such as xor b. By we will mean 
the vector of all zeros. 

It is easy to define some operations on matrices. Note that we will want 1x1 matrices to really 
act like numbers, so our operations will have to be compatible with this viewpoint. 

First, we can multiply by a scalar (a number). This means just multiplying each entry by the 
same number. For example. 



1 2 


3 




2 


4 


6 


4 5 


6 




8 


10 


12 



Matrix addition is also easy. We add matrices element by element. For example. 



1 2 3 
4 5 6 



+ 



1 1 -1 
2 4 



2 3 
4 7 



2 
10 



If the sizes do not match, then addition is not defined. 

If we denote by the matrix of with all zero entries, by c, d scalars, and by A, B, C matrices, we 
have the following familiar rules. 

A + = A = + A, 
A + 5 = 5 + A, 
(A + 5) + C = A + (5 + C), 
c(A + B) = cA + cB, 
(c + d)A = cA + dA. 
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Another useful operation for matrices is the so-called transpose. This operation just swaps rows 
and columns of a matrix. The transpose of A is denoted by A^. Example: 



1 2 3 
4 5 6 



1 4 

2 5 

3 6 



3.2.2 Matrix multiplication 

Let us now define matrix multiplication. First we define the so-called dot product (or inner product) 
of two vectors. Usually this will be a row vector multiplied with a column vector of the same size. 
For the dot product we multiply each pair of entries from the first and the second vector and we sum 
these products. The result is a single number. For example, 



\ai a2 as 



Uibi + a2b2 + a^b^. 



And similarly for larger (or smaller) vectors. 

Armed with the dot product we can define the product of matrices. First let us denote by row,(A) 
the row of A and by column/A) the column of A. For an m x n matrix A and mnx p matrix 
B we can define the product AB. We let AB be an m x p matrix whose if^ entry is 

row/(A) • column/5). 

Do note how the sizes match up. Example: 



2 
5 



1 -1 
1 1 1 
1 

1 • 1 +2- 1 + 3 • 1 
4 • 1 + 5 • 1 -I- 6 • 1 



1 •0 + 2- 1+3-0 
4-0-H5- 1 + 6-0 



1 •(-l) + 2- 1+3-0 
4- (-1) + 5- 1 + 6-0 





6 2 1 




15 5 1 



For multiplication we want an analogue of a 1. This analogue is the so-called identity matrix. 
The identity matrix is a square matrix with Is on the main diagonal and zeros everywhere else. It is 
usually denoted by /. For each size we have a diff'erent identity matrix and so sometimes we may 
denote the size as a subscript. For example, the 1^ would be the 3 x 3 identity matrix 



I = h 



1 
1 
1 



92 



CHAPTERS. SYSTEMS OF ODES 



We have the following rules for matrix multiplication. Suppose that A, B, C are matrices of the 
correct sizes so that the following make sense. Let a denote a scalar (number). 

A(BC) = (AB)C, 
A(B + C)=AB + AC, 
(B + C)A = BA + CA, 

a(AB) = (aA)B = A(aB), 
IA=A= AI. 



A few warnings are in order. 



(i) AB # BA in general (it may be true by fluke sometimes). That is, matrices do not commute. 
For example take A = [ } } ] and B = [02]- 

(ii) AB = AC does not necessarily imply B = C, even if A is not 0. 

(iii) AB = does not necessarily mean that A = or 5 = 0. For example take A = 5 = [ ^ q ]. 

For the last two items to hold we would need to "divide" by a matrix. This is where the matrix 
inverse comes in. Suppose that A and B arenxn matrices such that 



AB = I = BA. 



Then we call B the inverse of A and we denote B by A~^ If the inverse of A exists, then we call A 

invertible. If A is not invertible we sometimes say A is singular. 

If A is invertible, then AB = AC does imply that 5 = C (in particular the inverse of A is unique). 
We just multiply both sides by A'^ to get A'^AB = A'^AC or IB = IC or B = C. It is also not hard 
to see that (A'^)"^ = A. 



3.2.3 The determinant 

We can now talk about determinants of square matrices. We define the determinant of a 1 X 1 matrix 
as the value of its only entry. For a 2 x 2 matrix we define 



det 



a b 
c d 



def , 

= ad 



be. 



Before trying to compute the determinant for larger matrices, let us first note the meaning of the 
determinant. Consider an n x n matrix as a mapping of the n dimensional eucUdean space R" to R". 
In particular, a 2 x 2 matrix A is a mapping of the plane to itself, where £gets sent to Ax. Then the 
determinant of A is the factor by which the area of objects gets changed. If we take the unit square 
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(square of side 1) in the plane, then A takes the square to a parallelogram of area |det(A)|. The sign 
of det(A) denotes changing of orientation (negative if the axes got flipped). For example, let 



A = 



1 1 
-1 1 



Then det(A) = 1 + 1=2. Let us see where the square with vertices (0, 0), (1,0), (0, 1), and (1,1) 
gets sent. Clearly (0, 0) gets sent to (0, 0). 



1 1 




1 




1 




1 1 









1 




1 1 




1 




2 


-1 1 









-1 




-1 1 




1 




1 




-1 1 




1 








So the image of the square is another square. The image square has a side of length ^/2 and is 

therefore of area 2. 

If you think back to high school geometry, you may have seen a formula for computing the area 
of a parallelogram with vertices (0, 0), (a, c), (b, d) and (a + b,c + d). And it is precisely 



det 



a b 
c d 



The vertical lines above mean absolute value. The matrix [ ^ ^ ] carries the unit square to the given 
parallelogram. 

Now we can define the determinant for larger matrices. We define A,y as the matrix A with the 
row and the 7* column deleted. To compute the determinant of a matrix, pick one row, say the 
row and compute. 



det(A) = £(-iy^^fl,-,det(A,-,). 



For the first row we get 

det(A) = an det(Aii) - an det(Ai2) + a^ det(Ai3) - 



I +ai„ det(Ai„) if n is odd, 
1 -ain det(A i„) if n even. 



We alternately add and subtract the determinants of the submatrices A,y for a fixed / and all j. For a 
3x3 matrix, picking the first row, we would get det(A) = an det(Aii) - 012 det(Ai2) + a^ det(Ai3). 
For example. 



det 



1 2 3 
4 5 6 
7 8 9 



= 1 • det 



5 6 
8 9 



- 2 • det 



4 6 
7 9 



+ 3 • det 



4 5 
7 8 



= 1(5 • 9 - 6 • 8) - 2(4 • 9 - 6 • 7) + 3(4 • 8 - 5 • 7) = 0. 
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The numbers (-1)'^^ det(A,y) are called cofactors of the matrix and this way of computing the 
determinant is called the cofactor expansion. It is also possible to compute the determinant by 
expanding along columns (picking a column instead of a row above). 

Note that a common notation for the determinant is a pair of vertical lines: 



a b 
c d 



= det 



a b 
c d 



I personally find this notation confusing as vertical lines usually mean a positive quantity, while 
determinants can be negative. I will not use this notation in this book. 

One of the most important properties of determinants (in the context of this course) is the 
following theorem. 

Theorem 3.2.1. Annxn matrix A is invertible if and only j/'det(A) 0. 
In fact, there is a formula for the inverse of a 2 x 2 matrix 



a b 
c d 



-1 



1 



ad - be 



d -b 
-c a 



Notice the determinant of the matrix in the denominator of the fraction. The formula only works if 
the determinant is nonzero, otherwise we are dividing by zero. 



3.2.4 Solving linear systems 

One application of matrices we will need is to solve systems of linear equations. This is best shown 
by example. Suppose that we have the following system of linear equations 

2x\ + 2x2 + 2jc3 = 2, 

X\ -\- JC2 + 3^3 = 5, 
Xi + AX2 + x^ = 10. 

Without changing the solution, we could swap equations in this system, we could multiply any 
of the equations by a nonzero number, and we could add a multiple of one equation to another 
equation. It turns out these operations always suffice to find a solution. 

It is easier to write the system as a matrix equation. Note that the system can be written as 



"2 2 2" 








'2' 


1 1 3 




X2 




5 


1 4 1 








10 
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To solve the system we put the coefficient matrix (the matrix on the left hand side of the equation) 
together with the vector on the right and side and get the so-called augmented matrix 



' 2 


2 


2 


2 


1 


1 


3 


5 


1 


4 


1 


10 



We apply the following three elementary operations. 

(i) Swap two rows. 

(ii) Multiply a row by a nonzero number. 

(iii) Add a multiple of one row to another row. 

We will keep doing these operations until we get into a state where it is easy to read off the answer, 
or until we get into a contradiction indicating no solution, for example if we come up with an 
equation such as = 1. 

Let us work through the example. First multiply the first row by 1/2 to obtain 



1 


1 


1 


1 


1 


1 


3 


5 


1 


4 


1 


10 



Now subtract the first row from the second and third row. 



' 1 


1 


1 


1 " 








2 


4 





3 





9 



Multiply the last row by and the second row by V2- 



Swap rows 2 and 3. 



1 


1 


1 


1 








1 


2 





1 





3 


1 


1 


1 


1 





1 





3 








1 


2 



Subtract the last row from the first, then subtract the second row from the first. 



1 








-4 " 





1 





3 








1 


2 



If we think about what equations this augmented matrix represents, we see that xi = -4, X2 = 3, 
and X3 = 2. We try this solution in the original system and, voila, it works! 
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Exercise 3.2.1; Check that the solution above really solves the given equations 
If we write this equation in matrix notation as 

Ax = b, 
and S is the vector 



where A is the matrix 
inverse. 



2 2 2 
1 1 3 
1 4 1 



The solution can be also computed via the 
x = A-^Ax = A-^b. 



One last note to make about linear systems of equations is that it is possible that the solution is 
not unique (or that no solution exists). It is easy to tell if a solution does not exist. If during the 
row reduction you come up with a row where all the entries except the last one are zero (the last 
entry in a row corresponds to the right hand side of the equation) the system is inconsistent and 
has no solution. For example if for a system of 3 equations and 3 unknowns you find a row such as 
[0 I 1 ] in the augmented matrix, you know the system is inconsistent. 

You generally try to use row operations until the following conditions are satisfied. The first 
nonzero entry in each row is called the leading entry. 

(i) There is only one leading entry in each column. 

(ii) All the entries above and below a leading entry are zero. 

(iii) All leading entries are 1. 

Such a matrix is said to be in reduced row echelon form. The variables corresponding to columns 
with no leading entries are said to he, free variables. Free variables mean that we can pick those 
variables to be anything we want and then solve for the rest of the unknowns. 

Example 3.2.1: The following augmented matrix is in reduced row echelon form. 



1 


2 





3 








1 


1 















Suppose the variables are xi, X2, and xt,. Then X2 is the free variable, jci = 3 - 2x2, and xj, = 1. 
On the other hand if during the row reduction process you come up with the matrix 



' 1 


2 


13 


3 " 








1 


1 











3 



there is no need to go further. The last row corresponds to the equation Oxi + 0x2 + 0x3 = 3, which 
is preposterous. Hence, no solution exists. 
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3.2.5 Computing the inverse 

If the coefficient matrix is square and there exists a unique solution x to Aj? = ^ for any ^, then A 
is invertible. In fact by multiplying both sides by A"' you can see that x = A~^b. So it is useful to 
compute the inverse if you want to solve the equation for many different right hand sides b. 

The 2x2 inverse can be given by a formula, but it is also not hard to compute inverses of larger 
matrices. While we will not have too much occasion to compute inverses for larger matrices than 
2 X 2 by hand, let us touch on how to do it. Finding the inverse of A is actually just solving a bunch 
of linear equations. If we can solve Axk = where is the vector with all zeros except a 1 at the 
k^^ position, then the inverse is the matrix with the columns Xk for k = I, . . . ,n (exercise: why?). 
Therefore, to find the inverse we can write a larger nx2n augmented matrix [A | / ], where / is the 
identity. We then perform row reduction. The reduced row echelon form of [ A | / ] will be of the 
form [ / I A~^ ] if and only if A is invertible. We can then just read off the inverse A~^ 



3.2.6 Exercises 

Exercise 3.2.2; Solve [34]^ = [g]^)' using matrix inverse. 
Exercise 3.2.3; Compute determinant of 



9 -2 -6 
-8 3 6 

10 -2 -6 



Exercise 3.2.4; Compute determinant of 
to make the calculations simpler 



12 3 1 
4 5 
6 7 
8 10 1 



. Hint: Expand along the proper row or column 



Exercise 3.2.5; Compute inverse of 



1 2 3 
1 1 1 
1 



Exercise 3.2.6; For which h is 

Infinitely many? 

Exercise 3.2.7; For which h is 
Exercise 3.2.8; Solve 
Exercise 3.2.9; Solve 



9 -2 -6 
-8 3 6 

10 -2 -6 



1 2 3 
4 5 6 
7 8/1 



h 1 1 

hO 

1 1 h 



X = 



not invertible? Is there only one such h? Are there several? 



not invertible? Find all such h. 



537 

8 4 4 
6 3 3 



X = 



3 2 3 




'2' 


3 3 3 3 


-> 

X = 





2 4 2 


4 


2 3 4 3 




1 



Exercise 3.2.10; Solve 

Exercise 3.2.11; Find 3 nonzero 2x2 matrices A, B, and C such that AB = AC but B C. 
Exercise 3.2.101; Compute determinant of 2 3 -5 

^ "^1-10 
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Exercise 3.2.102; Find t such that [ _\ 2 ] invertible. 
Exercise 3.2.103; Solve [ } ii ] J? = [ io ]• 

Exercise 3.2.104; Suppose a, b, c are nonzero numbers. Let M = N = 
M-\ b) Compute N~\ 



a 
bO 
0c 



a) Compute 
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3.3 Linear systems of ODEs 



Note: less than 1 lecture, second part of §5.1 in [BP], §7.4 in [BD] 

First let us talk about matrix or vector valued functions. Such a function is just a matrix whose 
entries depend on some variable. If t is the independent variable, we write a vector valued function 
x(t) as 

Xi(t) 



X2{t) 
Xn{t) 



Similarly a matrix valued function A{t) is 



A{t) = 



«ii(0 an{t) 
aiiit) ^22(0 

an\{t) aniit) 



ainit) 
ajnit) 

(^nnif) 



We can talk about the derivative A'{t) or ^. This is just the matrix valued function whose /j* entry 
is a'..{t). 

Rules of differentiation of matrix valued functions are similar to rules for normal functions. Let 
A{t) and B{t) be matrix valued functions. Let c a scalar and let C be a constant matrix. Then 

(A(0 + Bit))' = A'{t) + B'it), 

(A{t)B(t))' = A'{t)B{t) + A{t)B'{t), 
{cA{t))' = cA'it), 
{CA(t))' = CA'it), 
(A(OC)' = A'it)C. 

Note the order of the multiplication in the last two expressions. 

A first order linear system of ODEs is a system that can be written as the vector equation 

rit) = Pit)m+f(t), 

-> 

where Pit) is a matrix valued function, and xit) and fit) are vector valued functions. We will often 
suppress the dependence on t and only write x = Px + f. A solution of the system is a vector 
valued function x satisfying the vector equation. 
For example, the equations 

x'l = 2txi + e'x2 + t^, 

Xi 



- X2 + e , 
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can be written as 



X = 



'2t e' 






lA -1 









We will mostly concentrate on equations that are not just linear, but are in fact constant coefficient 

equations. That is, the matrix P will be constant; it will not depend on t. 

-> -> 

When / = (the zero vector), then we say the system is homogeneous. For homogeneous linear 
systems we have the principle of superposition, just hke for single homogeneous equations. 

Theorem 3.3.1 (Superposition). Let x = Pxhe a linear homogeneous system ofODEs. Suppose 
that x\,. . . ,Xn are n solutions of the equation, then 



X 



C\Xi + C2X2 + • ■ • + CnXn, 



(3.1) 



is also a solution. Furthermore, if this is a system ofn equations (P is n X n), and 
linearly independent, then every solution can be written as (3.1) . 

Linear independence for vector valued functions is the same idea as for normal functions. The 
vector valued functions x\,X2, . ■ ■ ,Xn are linearly independent when 

-> -> , -> ft 

CiXy + C2X2 + • ■ • + CnXf, — U 

has only the solution ci = C2 = • ■ ■ = c„ = 0, where the equation must hold for all t. 

Example 3.3.1: x\ = [ '^^ ]> ^2 = [ i+j , ^3 = [ "f ] are hnearly depdendent because xi + X3 = X2, and 
this holds for all L So ci = 1, C2 = -1, and C3 = 1 above will work. 

On the other hand if we change the example just slightly xi = ['t\ ^2 = [ ? ^3 = [ ~i ]' then 

the functions are linearly independent. First write CiXi + C2X2 + c-^x-^ = 6 and note that it has to hold 
for all t. We get that 



Cit^ - Cst^ 




0" 


Cit + C2t + C3 








—f. —f. —f 

C\X\ + C2X2 + — 

In other words c\t^ - c-^t^ = and cit + C2t + C3 = 0. If we set t = 0, then the second equation 
becomes C3 = 0. But then the first equation becomes Cit^ = for all t and so ci = 0. Thus the 
second equation is just C2t = 0, which means C2 = 0. So ci = C2 = C3 = is the only solution and 
xi, X2, and X3 are linearly independent. 



The linear combination ciXi + C2X2 + 



+ c„Xn could always be written as 

x(t)e, 



where X(t) is the matrix with columns Xi, . . . , x,„ and c is the column vector with entries ci, . . . , c„. 
The matrix valued function X(t) is called the fundamental matrix, or \he, fundamental matrix solution. 

To solve nonhomogeneous first order linear systems, we use the same technique as we applied 
to solve single linear nonhomogeneous equations. 



3.3. LINEAR SYSTEMS OF ODES 



101 



Theorem 3.3.2. Let x = Px^ f he a linear system ofODEs. Suppose Xp is one particular solution. 
Then every solution can be written as 

-> ^ I ~* 

X — Xc I Xp, 

where X'f^ IS CI solution to the associated homogeneous equation (x = Px). 

So the procedure will be the same as for single equations. We find a particular solution to 
the nonhomogeneous equation, then we find the general solution to the associated homogeneous 
equation, and finally we add the two together. 

Alright, suppose you have found the general solution x' = Px + f. Now you are given an initial 
condition of the form x(to) = b for some constant vector b. Suppose that X(t) is the fundamental 
matrix solution of the associated homogeneous equation (i.e. columns of X(t) are solutions). The 
general solution can be written as 

x(t) = X(t)c + Xp(t). 

We are seeking a vector c such that 

b = x(to) = X{to)c + Xp(to). 

In other words, we are solving for c the nonhomogeneous system of linear equations 

X(to)c = b-Xp{to). 

Example 3.3.2: In § 3.1 we solved the system 

/ 

— Xi, 

t 

^2 — X\ — X2, 

with initial conditions JCi(O) = 1, ^2(0) = 2. 

-> 

This is a homogeneous system, so fit) = 0. We write the system and the initial conditions as 



X 



1 
1 -1 



X, 



m = 



We found the general solution was xi = c^e' and xj = ye' + cje '. Letting ci = 1 and C2 = 0, 
we obtain the solution |^ (i/2)e' ]• Letting ci = and C2 = 1, we obtain ^ j. These two solutions are 
linearly independent, as can be seen by setting t = 0, and noting that the resulting constant vectors 
are linearly independent. In matrix notation, the fundamental matrix solution is, therefore. 



X(t) 







\e^ e-\ 



Hence to solve the initial problem we solve the equation 



X(0)c = b. 
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1 





-> 


1 


1 

_2 


1 


c 


2 



e' 




1 










3 

.2. 




je' + \e-\ 



or in other words. 

After a single elementary row operation we find that c = [ 3)2]- Hence our solution is 

At) = x(t)c 

This agrees with our previous solution. 

3.3.1 Exercises 

Exercise 3.3.1; Write the system x[ = 2xi - 3tX2 + sin?, x'2 = e'xi + 3x2 + cost in the form 

f = P(Of+/(0. 

Exercise 3.3.2; a) Verify that the system x' = [H] xhas the two solutions [\]e^' and [ _\ ] e~^'. b) 
Write down the general solution, c) Write down the general solution in the form Xi =?, X2 =? (i.e. 
write down a formula for each element of the solution). 

Exercise 3.3.3; Verify that [ } ] and [ _\ ] e* are linearly independent. Hint: Just plug in t = Q. 

Exercise 3.3.4; Verify that 1 1 1 e* and | -i | e* and -i e^* are linearly independent. Hint: You must 
be a bit more tricky than in the previous exercise. 

Exercise 3.3.5; Verify that ^ j and ^4 j are linearly independent. 

Exercise 3.3.101; Are ^ j and [ ^2, ] linearly independent? Justify. 

Exercise 3.3.102; Are ^ j , |^ f j and ^ \' j linearly independent? Justify. 
Exercise 3.3.103; Write x' = 3x - y + e\ y' = tx in matrix notation. 

Exercise 3.3.104; a) Write x[ = 2tX2, x'^ = 2tX2 in matrix notation, b) Solve and write the solution 
in matrix notation. 
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3.4 Eigenvalue method 

Note: 2 lectures, §5.2 in [EP], part of §7.3, §7.5, and §7.6 in [BDJ 

In this section we will learn how to solve linear homogeneous constant coefficient systems of 
ODEs by the eigenvalue method. Suppose we have such a system 

x' = Px, 

where P is a constant square matrix. We wish to adapt the method for the single constant coefficient 
equation by trying the function However, x is a vector. So we try x = ve'", where v is an 
arbitrary constant vector. We plug this .^into the equation to get 

Ave^' = Pve^'. 

We divide by e'*' and notice that we are looking for a scalar X and a vector v that satisfy the equation 

Av = Pv. 

To solve this equation we need a little bit more linear algebra, which we now review. 

3.4.1 Eigenvalues and eigenvectors of a matrix 

Let A be a constant square matrix. Suppose there is a scalar A and a nonzero vector v such that 

Av = Av. 

We then call A an eigenvalue of A and v is said to be a corresponding eigenvector. 

Example 3.4.1: The matrix [ ^ } ] has an eigenvalue of A = l with a corresponding eigenvector [ ^ ] 
because 



2 1 




1 




2' 




1 


1 












= 2 






Let us see how to compute the eigenvalues for any matrix. We rewrite the equation for an 
eigenvalue as 

(A - AI)v = 6. 

We notice that this equation has a nonzero solution v only if A - AI is not invertible. Were it 
invertible, we could write (A - Aiy^(A - AI)v = (A - Aiy^O, which implies v = 0. Therefore, A 
has the eigenvalue A if and only if A solves the equation 

det(A - AI) = 0. 

Consequently, we will be able to find an eigenvalue of A without finding a corresponding 
eigenvector. An eigenvector will have to be found later, once A is known. 
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Example 3.4.2: Find all eigenvalues of 
We write 



2 1 1 
1 2 
2 







"2 


1 


1 




1 














det 




1 


2 





-A 





1 







= det 














2 










1 









1 



2- A 



\2-A 1 

1 2- A 


= (2 - A)i(2 - Af - 1) = -(A - l)(A - 2)(A - 3). 
and so the eigenvalues are A= I, A = 2, and A = 3. 

Note that for an n x n matrix, the polynomial we get by computing det(A - AI) will be of degree 
n, and hence we will in general have n eigenvalues. Some may be repeated, some may be complex. 

To find an eigenvector corresponding to an eigenvalue A, we write 

(A-AI)^^=6, 

and solve for a nontrivial (nonzero) vector v. If A is an eigenvalue, this will always be possible. 



Example 3.4.3: Find an eigenvector of 
We write 



2 1 1 
1 2 
2 



corresponding to the eigenvalue A = 3. 





f 


2 


1 


1 




1 








^ 




Vi 




(A - AI)v = 




1 


2 





-3 





1 









V2 














2 










1 


) 




V3_ 





-1 1 1 

1 -1 
0-1 





Vl" 




V2 




V3 



6. 



It is easy to solve this system of linear equations. We write down the augmented matrix 

1 



-1 
1 




-1 



1 




-1 

and perform row operations (exercise: which ones?) until we get 



1 


-1 














1 


















The equations the entries of v have to satisfy are, therefore, Vi - V2 = 0, V3 = 0, and V2 is a free 
variable. We can pick V2 to be arbitrary (but nonzero) and let vi = V2 and of course V3 = 0. For 



example, v = 



Let us verify that we really have an eigenvector corresponding to A = 3: 



'2 1 1 




1 




3" 




1" 


1 2 




1 




3 


= 3 


1 


2 


















Yay! It worked. 
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Exercise 3.4.1 (easy); Are eigenvectors unique? Can you find a different eigenvector for A = 3 in 

the example above? How are the two eigenvectors related? 

Exercise 3.4.2; Note that when the matrix is 2x2 you do not need to write down the augmented 
matrix and do row operations when computing eigenvectors ( if you have computed the eigenvalues 
correctly). Can you see why? Try it for the matrix [W]- 



3.4.2 The eigenvalue method with distinct real eigenvalues 

OK. We have the system of equations 

x' = Px. 

We find the eigenvalues Ai, A2, . . . , An of the matrix P, and corresponding eigenvectors vi,V2, v„. 
Now we notice that the functions vie"^^', V2e'^^', ^e'^"' are solutions of the system of equations 
and hence x = cii^ie'*'^ + C2^^2e'^^' + • • • + Cni^^e"^"' is a solution. 

Theorem 3.4.1. Take ^' = P£ IfP is annxn constant matrix that has n distinct real eigenvalues 
Ai, A2, . .. , An, then there exist n linearly independent corresponding eigenvectors i^i, V2. • • • , ^n, cind 
the general solution to x = Pxcan be written as 



X = civie ^ + C2V2e + 



+ Cn^ne^"'. 



The corresponding fundamental matrix solution is X(t) = [ vi^'^'' 
is, X(t) is the matrix whose column is vje"^^'. 



V2e 



VnC'""']. That 



Example 3.4.4: Suppose we take the system 



2 1 1 
1 2 
2 



X. 



Find the general solution. 

We have found the eigenvalues 1,2,3 earlier. We have found the eigenvector 



for the 



eigenvalue 3. Similarly we find the eigenvector 
2 (exercise: check). Hence our general solution is 



for the eigenvalue 1, and 



for the eigenvalue 





1 









1 




Cie' + c^e^* 


X = C\ 


-1 


e' + C2 


1 


e'' + C3 


1 


e" = 


-C\e' + C2e^' + c^e^' 









-1 












In terms of a fundamental matrix solution 

f =Z(Oc = 







e^' 









Cl 




C3. 
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Exercise 3.4.3; Check that this x really solves the system. 

Note: If we write a homogeneous linear constant coefficient n"^ order equation as a first order 
system (as we did in § 3.1), then the eigenvalue equation 

det{P -AI) = 

is essentially the same as the characteristic equation we got in § 2.2 and § 2.3. 



3.4.3 Complex eigenvalues 

A matrix might very well have complex eigenvalues even if all the entries are real. For example, 
suppose that we have the system 

[1 r 

-1 1 



X = 



X. 



Let us compute the eigenvalues of the matrix P = [ ij } ] . 



det(P - AI) = det 



I- A 1 
-1 I- A 



= (l- Af + 1 = A^ -2A + 2 = 0. 



Thus A = \ ±i. The corresponding eigenvectors will also be complex. First take A = \ - i. 



(P-(l-iW=0, 
i I 



-1 i 



The equations ivi + V2 = and -Vi + iv2 = are multiples of each other. So we only need to consider 
one of them. After picking V2 = 1, for example, we have an eigenvector v = [ 5 ]. In similar fashion 
we find that [ 7 ] is an eigenvector corresponding to the eigenvalue 1 + /. 
We could write the solution as 



Cl 



e^'-'^' + C2 



1 



ciie 



{i-i)t 



cie^^ * + C2e 



(l+i)t 



We would then need to look for complex values ci and C2 to solve any initial conditions. It is perhaps 
not completely clear that we get a real solution. We could use Euler's formula and do the whole 
song and dance we did before, but we will not. We will do something a bit smarter first. 

We claim that we did not have to look for a second eigenvector (nor for the second eigenvalue). 
All complex eigenvalues come in pairs (because the matrix P is real). 

First a small side note. The real part of a complex number z can be computed as where the 
bar above z means a + ib = a - ib. This operation is called the complex conjugate. Note that if a is 
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a real number, then a = a. Similarly we can bar whole vectors or matrices. If a matrix P is real, 
then P = P. We note that Px = Px = Px. Therefore, 



{P - AI)v = {P- AI)v. 

So if V is an eigenvector corresponding to the eigenvalue A = a + ib, then v is an eigenvector 
corresponding to the eigenvalue A = a - ib. 

Suppose that a + ib is a complex eigenvalue of P, and v is a corresponding eigenvector. Then 



Xi = ve 



(a+ih)t 



is a solution (complex valued) of x' = Px. Then note that = e" and so 



X2 = Xi = ve 



(a-ih)t 



is also a solution. The function 



-* . -> 



f3 = Refi = RevV-'-^)' = = 

2 2 

is also a solution. And x^, is real- valued! Similarly as Imz = ^ is the imaginary part, we find that 

-> -> 

Xi — X2 



X4 = lmxi 



2/ 



is also a real-valued solution. It turns out that xt, and X4 are linearly independent. We will use 
Euler's formula to separate out the real and imaginary part. 



Returning to our problem. 







/ 


1 




1 



(e' cos t - ie' sin t) 



ie' cos t + e' sin t 
e' cos t - ie' sin t 



Then 



Rexi 
I 111 .\' = 



e sm t 
e'cos t 

e' cos t 
-e' sin t 



are the two real- valued linearly independent solutions we seek. 
Exercise 3.4.4; Check that these really are solutions. 
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The general solution is 

Cie' sin? + C2e'cos t 
cie'cos t - C2e' sin? 

This solution is real-valued for real Ci and C2. Now we can solve for any initial conditions that we 
may have. 

Let us summarize as a theorem. 

Theorem 3.4.2. Let P be a real-valued constant matrix. If P has a complex eigenvalue a + ib and a 
corresponding eigenvector v, then P also has a complex eigenvalue a — ib with a corresponding 
eigenvector v. Furthermore , x = Px has two linearly independent real-valued solutions 

fi = Re^e^"^"'^', and = Imi/e^""^*^'. 

So for each pair of complex eigenvalues we get two real- valued linearly independent solutions. 
We then go on to the next eigenvalue, which is either a real eigenvalue or another complex eigenvalue 
pair. If we had n distinct eigenvalues (real or complex), then we will end up with n linearly 
independent solutions. 

We can now find a real-valued general solution to any homogeneous system where the matrix 
has distinct eigenvalues. When we have repeated eigenvalues, matters get a bit more complicated 
and we will look at that situation in § 3.7. 



X = 





e' sin t 




e'^cos t 




e' cos t 




-e' sin? 



3.4.4 Exercises 

Exercise 3.4.5 (easy); Let A be a 3 x 3 matrix with an eigenvalue of 3 and a corresponding 
eigenvector v = -\ . Find Av. 

Exercise 3.4.6; a) Find the general solution of x\ = 2x\, x\ = 3x2 using the eigenvalue method 
(first write the system in the form x - Ax), b) Solve the system by solving each equation separately 
and verify you get the same general solution. 

Exercise 3.4.7; Find the general solution of x\ = 3xi -\- X2, x\ = 2x\ -I- Ax2 using the eigenvalue 
method. 



Exercise 3.4.8; Find the general solution of x\ = X\— 2x2, ^'2 = '^^i + ^2 using the eigenvalue 
method. Do not use complex exponentials in your solution. 



Exercise 3.4.9; a) Compute eigenvalues and eigenvectors of A 
solution of x' = Ax. 



9 -2 -6 
-8 3 6 

10 -2 -6 



. b) Find the general 



Exercise 3.4.10; Compute eigenvalues and eigenvectors of 



-2 -1 -1 
3 2 1 
-3 -1 
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Exercise 3.4.11; Let a, b, c, d, e, f be numbers. Find the eigenvalues of 



a b c 
Ode 
0/ 



Exercise 3.4.101; a) Compute eigenvalues and eigenvectors of A = 
x' = Af. 



1 3 
-1 1 

2 2 



b) Solve the system 



Exercise 3.4.102; a) Compute eigenvalues and eigenvectors of A = [_\ q]. b) Solve the system 
f = A£ 

Exercise 3.4.103; Solve x\ = X2, x'^ = xi using the eigenvalue method. 

Exercise 3.4.104; Solve x'^ = x^, x!^^ -x\ using the eigenvalue method. 
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X 


t 


X 




= p 




y_ 







3.5 Two dimensional systems and their vector fields 

Note: 1 lecture, part of §6.2 in [EPJ, parts of §7.5 and §7.6 in [BDJ 

Let us take a moment to talk about constant coefficient linear homogeneous systems in the plane. 
Much intuition can be obtained by studying this simple case. Suppose we have a 2 x 2 matrix P and 
the system 

(3.2) 

The system is autonomous (compare this section to § 1.6) and so we can draw a vector field (see 
end of § 3.1). We will be able to visually tell what the vector field looks like and how the solutions 
behave, once we find the eigenvalues and eigenvectors of the matrix P. For this section, we assume 
that P has two eigenvalues and two corresponding eigenvectors. 

Case 1. Suppose that the eigenvalues of P 
are real and positive. We find two corresponding 
eigenvectors and plot them in the plane. For ex- 
ample, take the matrix [ o 2 ] • The eigenvalues are 
1 and 2 and corresponding eigenvectors are [ ] 
and [ } ]. See Figure 3.3. 

Now suppose that x and y are on the line de- 
termined by an eigenvector v for an eigenvalue A. 
That is, [y] = av for some scalar a. Then 



X 




X 


= p 




y_ 




y_ 



P{av) = a(Pv) = aAv. 



Figure 3.3: Eigenvectors of P. 



The derivative is a multiple of v and hence points 
along the line determined by v. As /I > 0, the 
derivative points in the direction of v when a is 
positive and in the opposite direction when a is 
negative. Let us draw the lines determined by the eigenvectors, and let us draw arrows on the lines 
to indicate the directions. See Figure 3.4 on the facing page. 

We fill in the rest of the arrows for the vector field and we also draw a few solutions. See 
Figure 3.5 on the next page. Notice that the picture looks like a source with arrows coming out from 
the origin. Hence we call this type of picture a source or sometimes an unstable node. 

Case 2. Suppose both eigenvalues were negative. For example, take the negation of the matrix 
in case 1, [ I2]. The eigenvalues are -1 and -2 and corresponding eigenvectors are the same, 
[q] and [ } ]. The calculation and the picture are almost the same. The only diff"erence is that the 
eigenvalues are negative and hence all arrows are reversed. We get the picture in Figure 3.6 on the 
facing page. We call this kind of picture a sink or sometimes a stable node. 
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Figure 3.4: Eigenvectors of P with directions. Figure 3.5: Example source vector field with 

eigenvectors and solutions. 
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Figure 3.6: Example sink vector field with 
eigenvectors and solutions. 



Figure 3.7: Example saddle vector field with 
eigenvectors and solutions. 



Case 3. Suppose one eigenvalue is positive and one is negative. For example the matrix [ o _2 ]• 
The eigenvalues are 1 and -2 and corresponding eigenvectors are [q] and [.3]. We reverse the 
arrows on one line (corresponding to the negative eigenvalue) and we obtain the picture in Figure 3.7. 
We call this picture a saddle point. 

For the next three cases we will assume the eigenvalues are complex. In this case the eigenvectors 
are also complex and we cannot just plot them in the plane. 

Case 4. Suppose the eigenvalues are purely imaginary. That is, suppose the eigenvalues are +ib. 
For example, let P = [ _°4 q]. The eigenvalues turn out to be +2i and eigenvectors are [ 2,] and [ _2,]- 
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Consider the eigenvalue 2i and its eigenvector [ 2,- ] . The real and imaginary parts of ve'^' are 



Re 
Im 



1 




2i 


e'^' = 


1 




2i 





cos(20 
-2 sin(20 

sin(20 
2 cos(20 



We can take any linear combination of them to get other solutions, which one we take depends on 
the initial conditions. Now note that the real part is a parametric equation for an ellipse. Same with 
the imaginary part and in fact any linear combination of the two. This is what happens in general 
when the eigenvalues are purely imaginary. So when the eigenvalues are purely imaginary, we get 
ellipses for the solutions. This type of picture is sometimes called a center. See Figure 3.8. 
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Figure 3.8: Example center vector field. 
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Figure 3.9: Example spiral source vector field. 



Case 5. Now suppose the complex eigenvalues have a positive real part. That is, suppose the 
eigenvalues are a + ib for some a> 0. For example, let P = [ _4 } ]. The eigenvalues turn out to be 
1 + 2z and eigenvectors are [ ,\ ] and [ _2, ]• We take 1 + 2/ and its eigenvector [ ] and find the real 
and imaginary of ve^'^^'^' are 



Re 



Im 



e^™ = e' 



cos(20 
-2 sin(20 

sin(20 
2 cos(20 



Note the e' in front of the solutions. This means that the solutions grow in magnitude while spinning 
around the origin. Hence we get a spiral source. See Figure 3.9. 
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Case 6. Finally suppose the complex eigenvalues have a negative real part. That is, suppose the 
eigenvalues are -a + ib for some a > 0. For example, let P = [ 4' i} ]. The eigenvalues turn out to 
be - 1 + 2z and eigenvectors are [ ] and [ ] . We take - 1 -2i and its eigenvector [ \- ] and find the 
real and imaginary of ve^"!"^')' are 



Re 
Im 



cos(20 
2 sin(2?) 

- sin(20 
2 cos(20 



Note the e ' in front of the solutions. This means that the solutions shrink in magnitude while 
spinning around the origin. Hence we get a spiral sink. See Figure 3.10. 




Figure 3.10: Example spiral sink vector field. 



We summarize the behavior of linear homogeneous two dimensional systems in Table 3.1. 



Eigenvalues 



Behavior 



real and both positive 

real and both negative 

real and opposite signs 

purely imaginary 

complex with positive real part 

complex with negative real part 



source / unstable node 
sink / stable node 
saddle 

center point / ellipses 
spiral source 
spiral sink 



Table 3.1: Summary of behavior of linear homogeneous two dimensional systems. 
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3.5.1 Exercises 

Exercise 3.5.1; Take the equation mx" + cx' +kx = 0, with m > 0, c > 0, k > Ofor the mass-spring 
system, a) Convert this to a system of first order equations, b) Classify for what m, c, k do you get 
which behavior c) Can you explain from physical intuition why you do not get all the different kinds 
of behavior here? 

Exercise 3.5.2; Can you find what happens in the case when P = [ } ] ? /« this case the eigenvalue 
is repeated and there is only one eigenvector What picture does this look like? 

Exercise 3.5.3; Can you find what happens in the case when P = [ \ \ ]? Does this look like any of 
the pictures we have drawn? 

Exercise 3.5.101; Describe the behavior of the following systems without solving: 

a) x' = X + y, y = X - y. 

b) x\ = xi + xi, x'2 = 2x2. 

c) X^ — 2x2f X2 — '2.X\. 

d) j^=x + 3y, y = -Ix - Ay. 

e) x! = X - Ay, y' = -Ax + y. 

Exercise 3.5.102; Suppose that x' = Ax where A is a 2 by 2 matrix with eigenvalues 2 ± i. Describe 
the behavior 

Exercise 3.5.103; Take [y]' = [ {] ] [ y ]• Draw the vector field and describe the behavior Is it one 
of the behaviours that we have seen before? 
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3.6 Second order systems and applications 

Note: more than 2 lectures, §5.3 in [EPJ, not in [BDJ 

3.6.1 Undamped mass-spring systems 

While we did say that we will usually only look at first order systems, it is sometimes more 
convenient to study the system in the way it arises naturally. For example, suppose we have 3 
masses connected by springs between two walls. We could pick any higher number, and the math 
would be essentially the same, but for simplicity we pick 3 right now. Let us also assume no friction, 
that is, the system is undamped. The masses are mi, m2, and ma and the spring constants are ki, 
k2, ks, and ^4. Let xi be the displacement from rest position of the first mass, and X2 and X3 the 
displacement of the second and third mass. We will make, as usual, positive values go right (as xi 
grows the first mass is moving right). See Figure 3.11. 



























WW 


mi 


m 


m2 




m3 



k4 



Figure 3.11: System of masses and springs. 



This simple system turns up in unexpected places. For example, our world really consists of 
many small particles of matter interacting together. When we try the above system with many more 
masses, we obtain a good approximation to how an elastic material behaves. By somehow taking a 
limit of the number of masses going to infinity, we obtain the continuous one dimensional wave 
equation (that we study in § 4.7). But we digress. 

Let us set up the equations for the three mass system. By Hooke's law we have that the force 
acting on the mass equals the spring compression times the spring constant. By Newton's second 
law we have that force is mass times acceleration. So if we sum the forces acting on each mass and 
put the right sign in front of each term, depending on the direction in which it is acting, we end up 
with the desired system of equations. 



mix" = -kiX\ + kjixj - X\) 
mjXj = -k2{x2 - .^i) + k^^xi, - X2) 

m^x" = -k3(X3 - X2) - k4X3 

We define the matrices 



M 



mi 
m2 
ma 



and 



K 



= -(ki + k2)X\ + k2X2, 

= k2Xi - (^2 + k3)X2 + kT,XT„ 

= kiX2- {h + h)x3. 



-{ki + k2) k2 

^2 —(^2 + ^3) k-i 

h -(ks + ^4) 
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We write the equation simply as 

Mx" = Kx. 

At this point we could introduce 3 new variables and write out a system of 6 equations. We claim 
this simple setup is easier to handle as a second order system. We will call x the displacement 
vector, M the mass matrix, and K the stiffness matrix. 

Exercise 3.6.1; Repeat this setup for 4 masses (find the matrices M and K). Do it for 5 masses. 
Can you find a prescription to do it for n masses? 

As with a single equation we will want to "divide by M." This means computing the inverse of 
M. The masses are all nonzero and M is a diagonal matrix, so comping the inverse is easy. 



^00 

mi 

0^0 

m2 

0^ 

m3 J 



This fact follows readily by how we multiply diagonal matrices. You should verify that MM ^ = 

M'^M = / as an exercise. 

Let A = M~^^. We look at the system x" = M'^Kx, or 

f " = Af . 

Many real world systems can be modeled by this equation. For simplicity, we will only talk about 
the given masses-and-springs problem. We try a solution of the form 

j^=^e"'. 

We compute that for this guess, ^" = a^ve"". We plug our guess into the equation and get 

c^^^e"' = A^e"'. 

We can divide by e"' to get that a^v - Av. Hence if or^ is an eigenvalue of A and v is a corresponding 
eigenvector, we have found a solution. 

In our example, and in other common applications, it turns out that A has only real negative 
eigenvalues (and possibly a zero eigenvalue). So we will study only this case. When an eigenvalue X 
is negative, it means that tt^ = /I is negative. Hence there is some real number o) such that -o? = A. 
Then a = +ioj. The solution we guessed was 

X = v{cos(a>t) + i sm(a>t)). 

By taking real and imaginary parts (note that is real), we find that ^^cos(oJt) and ^^sm(oJt) are 
linearly independent solutions. 

If an eigenvalue is zero, it turns out that both and vt are solutions, where v is a corresponding 
eigenvector. 
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Exercise 3.6.2; Show that if A has a zero eigenvalue and v is a corresponding eigenvector, then 
X = v(a + bt) is a solution of x" = Ax for arbitrary constants a and b. 

Theorem 3.6.1. Let A be an n x n matrix with n distinct real negative eigenvalues we denote by 
-col ^ > ■ ■ ■ > -^l> <^^d corresponding eigenvectors by v\, V2, ■ ■ ■ , Vn- If A is invertible (that 
is, ifooy > Q), then 

n 

x{t) = ^ v,(a,- cos(tt»,0 + bi sm{a)it)), 

i=l 

is the general solution of 

X — 

for some arbitrary constants a, and bi. If A has a zero eigenvalue, that is oji = 0, and all other 
eigenvalues are distinct and negative, then the general solution can be written as 



x(t) = vi(ai + bit) + Viifli cos(a>iO + bi sin(a>,0)- 

We can use this solution and the setup from the introduction of this section even when some of 
the masses and springs are missing. For example, when there are only 2 masses and only 2 springs, 
simply take only the equations for the two masses and set all the spring constants for the springs 
that are missing to zero. 

3.6.2 Examples 

Example 3.6.1: Suppose we have the system in Figure 3.12, with mi = 2, m2 = l,k\ =4, and 
k2 = 2. 





















Ml 




m2 



Figure 3.12: System of masses and springs. 



The equations we write down are 



2 










1 


X = 



or 



-(4 + 2) 2 
2 -2 



-3 1 
2 -2 



X, 
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We find the eigenvalues of A to be /I = -1, -4 (exercise). Now we find corresponding eigenvec- 
tors to be [ 2 ] and [ „\ ] respectively (exercise). 

We check the theorem and note that a»i = 1 and 0)2 = 2. Hence the general solution is 



(ai cos(0 + bi sin(O) + 



1 

-1 



{a2 cos(2?) + b2 sin(20). 



The two terms in the solution represent the two so-called natural or normal modes of oscillation. 
And the two (angular) frequencies are the natural frequencies. The two modes are plotted in 
Figure 3.13. 





Figure 3.13: The two modes of the mass-spring system. In the left plot the masses are moving in 
unison and the right plot are masses moving in the opposite direction. 



Let us write the solution as 



X = 



Ci COS{t - Qfi) -I- 



1 

-1 



C2 C0S(2? - Qf2). 



Ci cos(? - ai) 



The first term, 

Ci COS(? - QTi) 

2ci co%{t - ai) 

corresponds to the mode where the masses move synchronously in the same direction. 
The second term, 



C2 cos(2? - Q'2) = 



C2 cos(2? - 02) 
-C2 cos(2f - 02) 



corresponds to the mode where the masses move synchronously but in opposite directions. 

The general solution is a combination of the two modes. That is, the initial conditions determine 
the amplitude and phase shift of each mode. 
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Example 3.6.2: We have two toy rail cars. Car 1 of mass 2 kg is traveling at 3 '^s towards the 
second rail car of mass 1 kg. There is a bumper on the second rail car that engages at the moment 
the cars hit (it connects to two cars) and does not let go. The bumper acts like a spring of spring 
constant k = 2 N/m. The second car is 10 meters from a wall. See Figure 3.14. 



k 




< s* 

10 meters 



Figure 3.14: The crash of two rail cars. 



We want to ask several question. At what time after the cars link does impact with the wall 
happen? What is the speed of car 2 when it hits the wall? 

OK, let us first set the system up. Let t = Ohe the time when the two cars link up. Let xi be the 
displacement of the first car from the position at ? = 0, and let X2 be the displacement of the second 
car from its original location. Then the time when X2(t) = 10 is exactly the time when impact with 
wall occurs. For this t, x'2(t) is the speed at impact. This system acts just like the system of the 
previous example but without ki . Hence the equation is 



or 



2 






-2 


2 ■ 


1 


X 




2 


-2 




-1 


1 


-> 


X 




2 


-2 


X. 



We compute the eigenvalues of A. It is not hard to see that the eigenvalues are and -3 (exercise). 
Furthermore, eigenvectors are [ { ] and [ _2 ] respectively (exercise). We note that 6c»2 = V3 and we 
use the second part of the theorem to find our general solution to be 



X = 



(ai + hit) + 



1 

-2 



(a2 cos( V3 1) + h2 sin( V3 o) 



a\ + h\t + a2Cos(V3 + ^2 sin(V3 
ax +Z7i?-2a2Cos(V3 0-2Z72 sin(V3?) 



We now apply the initial conditions. First the cars start at position so xi(0) = and jc2(0) = 0. 
The first car is traveling at 3 so x\(SS) = 3 and the second car starts at rest, so ^2(0) = 0. The first 
conditions says 

a\ + a2 



= f(0) 
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It is not hard to see that this implies that a\ = a2 = 0. We plug ai and a2 and differentiate to get 



bi + V3Z72Cos(V3 
Z7i -2V3Z72Cos(V3 



So 



= f (0) = 



bi + yl3b2 
bi-2yl3b2 



It is not hard to solve these two equations to find bi = 2 and ^2 = Hence the position of our cars 
is (until the impact with the wall) 



2t+ -Wsin(V3 



j_ 
2t-^ 



sin(V3 



Note how the presence of the zero eigenvalue resulted in a term containing t. This means that the 
carts will be traveling in the positive direction as time grows, which is what we expect. 

What we are really interested in is the second expression, the one for X2. We have X2(t) = 
2t - ^ sin(V3 t). See Figure 3.15 for the plot of X2 versus time. 




Figure 3.15: Position of the second car in time (ignoring the wall). 



Just from the graph we can see that time of impact will be a little more than 5 seconds from 
time zero. For this we have to solve the equation 10 = X2(t) = 2t - ^ sin(V3 0- Using a computer 
(or even a graphing calculator) we find that Ampact ~ 5.22 seconds. 

As for the speed we note that = 2 - 2 cos(V3 0- At time of impact (5.22 seconds from t = 0) 
we get that x'^iti^p^ct) ~ 3.85. 

The maximum speed is the maximum of 2 - 2 cos('\^ t), which is 4. We are traveling at almost 
the maximum speed when we hit the wall. 
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Now suppose that Bob is a tiny person sitting on car 2. Bob has a Martini in his hand and would 
like to not spill it. Let us suppose Bob would not spill his Martini when the first car links up with 
car 2, but if car 2 hits the wall at any speed greater than zero, Bob will spill his drink. Suppose Bob 
can move car 2 a few meters towards or away from the wall (he cannot go all the way to the wall, 
nor can he get out of the way of the first car). Is there a "safe" distance for him to be at? A distance 
such that the impact with the wall is at zero speed? 

The answer is yes. Looking at Figure 3.15 on the facing page, we note the "plateau" between 
t = 3 and t = 4. There is a point where the speed is zero. To find it we need to solve XjCO = 0. This 
is when cos(V3 1) = I or in other words when t = • • • so on. We plug in the first value to 

obtain X2 ~ ^ 7.26. So a "safe" distance is about 7 and a quarter meters from the wall. 

Alternatively Bob could move away from the wall towards the incoming car 2 where another 
safe distance is « 14.51 and so on, using all the different t such that jCjCO = 0. Of course f = is 
always a solution here, corresponding to X2 = 0, but that means standing right at the wall. 

3.6.3 Forced oscillations 

Finally we move to forced oscillations. Suppose that now our system is 

x" =Ax + Fcosicot). (3.3) 

That is, we are adding periodic forcing to the system in the direction of the vector F. 

Just like before this system just requires us to find one particular solution Xp, add it to the general 
solution of the associated homogeneous system 4 and we will have the general solution to (3.3) . 
Let us suppose that to is not one of the natural frequencies of x" = Ax, then we can guess 

Xp = ccos(cot), 

where c is an unknown constant vector. Note that we do not need to use sine since there are only 
second derivatives. We solve for c to find Xp. This is really just the method of undetermined 
coefficients for systems. Let us differentiate Xp twice to get 

Xp = -o/ccos(cot). 

Now plug into the equation 

-o/ccos(a)t) = Accos{a)t) + F cos{cot) 
We cancel out the cosine and rearrange the equation to obtain 

(A + a?I)c = -P. 



So 



c = {A + o?I) \-F). 
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Of course this is possible only if (A + o/l) = (A - (-o/)I) is invertible. That matrix is invertible if 
and only if -oj^ is not an eigenvalue of A. That is true if and only if co is not a natural frequency of 
the system. 

Example 3.6.3: Let us take the example in Figure 3.12 on page 117 with the same parameters as 
before: mi = 2, itij = I, h = 4, and ^2 = 2. Now suppose that there is a force 2cos(30 acting on 
the second cart. 
The equation is 



X = 



-3 1 







2 -2 




2 



cos(30- 



We have solved the associated homogeneous equation before and found the complementary solution 
to be 



(ai cos(0 + bi sin(O) + 



1 

-1 



((32 cos(2f) + b2 sin(20). 



We note that the natural frequencies were 1 and 2. Hence 3 is not a natural frequency, we can 
try c cos(30- We can invert (A + 3^1) 





-3 


1 




6 


1 


-1 


' 7 


-1- 


1 




+ 32/j = 






40 

-1 
-20 


40 




2 


-2 


2 


7 




3 

20 1 



Hence, 



c = (A + to^I) \-F) = 



- 7 


-1- 









- 1 - 


40 


40 






20 


-1 


3 




-2 




-3 


-20 


20 






- 10- 



Combining with what we know the general solution of the associated homogeneous problem to 
be we get that the general solution to x" = Ax + Pcos(cot) is 



{a\ cos(0 + b\ sin(?)) + 



•1 



(^2 cos(2?) + bj sin(20) + 



cos(30- 



The constants ai, a2, b\, and b2 must then be solved for given any initial conditions. 



If a; is a natural frequency of the system resonance occurs because we will have to try a particular 
solution of the form 

~* 

Xp = ct s'm(a)t) + d cos(u)t). 

That is assuming that all eigenvalues of the coefficient matrix are distinct. Note that the amplitude 
of this solution grows without bound as t grows. 
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3.6.4 Exercises 

Exercise 3.6.3; Find a particular solution to 



X = 



-3 1 







2 -2 


f + 


2 



cos(20. 



Exercise 3.6.4 (challenging); Let us take the example in Figure 3.12 on page 117 with the same 
parameters as before: m\ = 2, ki =4, and ^2 = 2, except for m2, which is unknown. Suppose 
that there is a force cos(50 acting on the first mass. Find an m2 such that there exists a particular 
solution where the first mass does not move. 

Note: This idea is called dynamic damping. In practice there will be a small amount of damping 
and so any transient solution will disappear and after long enough time, the first mass will always 
come to a stop. 

Exercise 3.6.5; Let us take the Example 3.6.2 on page 119, but that at time of impact, cart 2 is 
moving to the left at the speed of 3 "is. a) Find the behavior of the system after linkup, b) Will the 
second car hit the wall, or will it be moving away from the wall as time goes on? c) At what speed 
would the first car have to be traveling for the system to essentially stay in place after linkup? 

Exercise 3.6.6; Let us take the example in Figure 3.12 on page 117 with parameters mi = mi = 1, 
ki = k2 = i. Does there exist a set of initial conditions for which the first cart moves but the second 
cart does not? If so, find those conditions. If not, argue why not. 

Exercise 3.6.101; Find the general solution to 

Exercise 3.6.102; Suppose there are three carts of equal mass m and connected by two springs of 
constant k (and no connections to walls). Set up the system and find its general solution. 

Exercise 3.6.103; Suppose a cart of mass 2 kg is attached by a spring of constant k = \ to a cart of 
mass 3 kg, which is attached to the wall by a spring also of constant k = \. Suppose that the initial 
position of the first cart is 1 meter in the positive direction from the rest position, and the second 
mass starts at the rest position. The masses are not moving and are let go. Find the position of the 
second mass as a function of time. 



1 


f" = 


-3 




' cos(2f) " 


2 


2 -4 


f + 





3 




6-3 
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3.7 Multiple eigenvalues 

Note: 1 or 1.5 lectures , §5.4 in [EP], §7.8 in [BD] 

It may very well happen that a matrix has some "repeated" eigenvalues. That is, the characteristic 
equation det(A - AI) = may have repeated roots. As we have said before, this is actually unlikely 
to happen for a random matrix. If we take a small perturbation of A (we change the entries of A 
slightly), then we will get a matrix with distinct eigenvalues. As any system we will want to solve 
in practice is an approximation to reality anyway, it is not indispensable to know how to solve these 
corner cases. It may happen on occasion that it is easier or desirable to solve such a system directly. 



3.7.1 Geometric multiplicity 

Take the diagonal matrix 



A = 



3 
3 



A has an eigenvalue 3 of multiplicity 2. We call the multiplicity of the eigenvalue in the characteristic 
equation the algebraic multiplicity. In this case, there also exist 2 linearly independent eigenvectors, 
[q] and [ [ ] corresponding to the eigenvalue 3. This means that the so-called geometric multiplicity 
of this eigenvalue is also 2. 

In all the theorems where we required a matrix to have n distinct eigenvalues, we only really 
needed to have n linearly independent eigenvectors. For example, x' = Ax has the general solution 



X = Ci 



e'' + C2 



Let us restate the theorem about real eigenvalues. In the following theorem we will repeat eigen- 
values according to (algebraic) multiplicity. So for the above matrix A, we would say that it has 
eigenvalues 3 and 3. 

Theorem 3.7.1. Take x' = Px. Suppose the matrix P is nxn, has n real eigenvalues (not necessarily 
distinct), A[, . . . , A„, and there are n linearly independent corresponding eigenvectors Vy, . . . , v„- 
Then the general solution to the ODE can be written as 



X 



civie-^" + C2V2e^^' + 



• + CnVnC 



A„t 



The geometric multiplicity of an eigenvalue of algebraic multiplicity n is equal to the number of 
corresponding linearly independent eigenvectors. The geometric multiplicity is always less than 
or equal to the algebraic multiplicity. We have handled the case when these two multiplicities are 
equal. If the geometric multiplicity is equal to the algebraic multiplicity, then we say the eigenvalue 
is complete. 
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In other words, the hypothesis of the theorem could be stated as saying that if all the eigenvalues 
of P are complete, then there are n linearly independent eigenvectors and thus we have the given 
general solution. 

If the geometric multiplicity of an eigenvalue is 2 or greater, then the set of linearly independent 
eigenvectors is not unique up to multiples as it was before. For example, for the diagonal matrix 
^ = [ 3 ] could also pick eigenvectors [ } ] and [ _\ ], or in fact any pair of two linearly 
independent vectors. The number of linearly independent eigenvectors corresponding to A is the 
number of free variables we obtain when solving Av = Av. We pick specific values for those free 
variables to obtain eigenvectors. If you pick different values, you may get different eigenvectors. 

3.7.2 Defective eigenvalues 

If an n X n matrix has less than n linearly independent eigenvectors, it is said to be deficient. Then 
there is at least one eigenvalue with an algebraic multiplicity that is higher than its geometric 
multiplicity. We call this eigenvalue defective and the difference between the two multiplicities we 
call the defect. 

Example 3.7.1: The matrix 

[3 1 
3 

has an eigenvalue 3 of algebraic multiplicity 2. Let us try to compute eigenvectors. 



1 




Vl 







V2_ 



= 0. 



We must have that vi = 0. Hence any eigenvector is of the form [ q ]. Any two such vectors are 
linearly dependent, and hence the geometric multiplicity of the eigenvalue is 1. Therefore, the 
defect is 1, and we can no longer apply the eigenvalue method directly to a system of ODEs with 
such a coefficient matrix. 

The key observation we will use here is that if /I is an eigenvalue of A of algebraic multiplicity 
m, then we will be able to find m linearly independent vectors solving the equation (A - APf^v = 0. 
We will call these generalized eigenvectors. 

Let us continue with the example A = [ q 3 ] and the equation x' = Ax. We have an eigenvalue 
A = 3 of (algebraic) multiplicity 2 and defect 1. We have found one eigenvector vi = [ q]. We have 
the solution 

Xi — Vic . 

In this case, let us try (in the spirit of repeated roots of the characteristic equation for a single 
equation) another solution of the form 

X2 = (V2 + Vit)e^'. 
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We differentiate to get 

f2' = ^^le^' + 3(V2 + vit)e^' = (3v2 + vi)e^' + 3^ite^'. 

As we are assuming that X2 is a solution, must equal Ax2, and 

Ax2 = A(V2 + viO e^' = Av2e^' + Avite^'. 

By looking at the coefficients of e^' and te^' we see 3v2 + vi = Ai/2 and 3vi = Avi. This means that 

(A - 3/)v2 = vi, and (A - 3/)vi = 0. 

Therefore, X2 is a solution if these two equations are satisfied. We know the second of these two 
equations is satisfied as i^i is an eigenvector. If we plug the first equation into the second we obtain 

(A - 3/)(A - 3IW2 = 0, or (A - 37)^2 = 0. 

If we can, therefore, find a ^^2 that solves (A - 3/)^V2 = ^ and such that (A - 3/)v2 = vi, then we are 
done. This is just a bunch of linear equations to solve and we are by now very good at that. 

We notice that in this simple case (A - 3/)^ is just the zero matrix (exercise). Hence, any vector 
V2 solves (A - 3/)^V2 = 0. We just have to make sure that (A - 3/)v2 = vi. Write 






1 




a 




1 










b 








By inspection we see that letting a = 0(a could be anything in fact) and b = I does the job. Hence 
we can take ^^2 = [ ? ]• Our general solution to jt' = Axis 



X = Ci 



e^' + C2 



+ 



t\ e 



3/ 



Cie^' + C2te^' 



C2e 



3? 



Let us check that we really do have the solution. First x[ = Ci3e^^ + C2e^* + 3c2te^' = 3xi + X2. Good. 
Now x'2 = 3c2e^' = 3x2. Good. 

Note that the system x' = A.x has a simpler solution since A is a so-called upper triangular 
matrix, that is every entry below the diagonal is zero. In particular, the equation for X2 does not 
depend on xi. Mind you, not every defective matrix is triangular. 

Exercise 3.7.1; Solve ^' = [l\ ]x by first solving for X2 and then for xi independently. Check that 
you got the same solution as we did above. 

Let us describe the general algorithm. Suppose that /I is an eigenvalue of multiplicity 2, defect 1. 
First find an eigenvector i^i of A. Then, find a vector V2 such that 

(A - Alfv2 = 6, 

(A-A/)i?2 = vi. 
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This gives us two linearly independent solutions 

This machinery can also be generalized to higher multiplicities and higher defects. We will not 
go over this method in detail, but let us just sketch the ideas. Suppose that A has an eigenvalue A of 
multiplicity m. We find vectors such that 

(A - Alfv = 6, but (A - Alf-^v ^ 6. 



Such vectors are called generalized eigenvectors. 
generalized eigenvectors V2 through i4 such that: 

(A - AI)^i 
(A - AI)^2 



For every eigenvector i^i we find a chain of 

= Vl, 



(A - AI)vk = Vk-i. 
We form the linearly independent solutions 

-> At 

x\ = Vie , 

X2 = (V2 + Vit)e^\ 



Vk + Vk-lt + Vk-2^ + 



+ V2 



(k-2)\ (k-l)\ 



Recall that k\ = 1 •2-3---(^- l)-^is the factorial. We proceed to find chains until we form m 
linearly independent solutions (m is the multiplicity). You may need to find several chains for every 
eigenvalue. 



3.7.3 Exercises 

Exercise 3.7.2; Let A = [ 3 Ij ]. Find the general solution of^' = A£ 



Exercise 3.7.3; Let A = 



5-44 

3 

-2 4-1 



. a) What are the eigenvalues? b) What is/are the defect(s) of the 



eigenvalue(s)? c) Find the general solution of x = Ax. 



Exercise 3.7.4; Let A = 



2 1 
020 
002 



a) What are the eigenvalues? b) What is/are the defect(s) of the 

eigenvalue(s)? c) Find the general solution of x' = Ax in two different ways and verify you get the 
same answer 
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Exercise 3.7.5; Let A = 



1 2 
-1 -2 -2 
-4 4 7 



. a) What are the eigenvalues? b) What is/are the defect(s) of the 



eigenvalue(s)? c) Find the general solution ofx = Ax. 



Exercise 3.7.6; Let A 



4 -2 
-1 -4 1 
-2 



. a) What are the eigenvalues? b) What is/are the defect(s) of the 



eigenvalue(s)? c) Find the general solution ofx' = Ax. 



Exercise 3.7.7; Let A = 



2 1 -1 
-10 2 
-1 -2 4 



. a) What are the eigenvalues? b) What is/are the defect(s) of the 



eigenvalue(s)? c) Find the general solution of ^' = Ax. 

Exercise 3.7.8; Suppose that A is a 2x2 matrix with a repeated eigenvalue X. Suppose that there 
are two linearly independent eigenvectors. Show that A = XL 



Exercise 3.7.101; I^t A = 



1 1 1 
1 1 1 
1 1 1 



a) What are the eigenvalues? b) What is/are the defect(s) of the 



eigenvalue(s)? c) Find the general solution ofx' = Ax. 



Exercise 3.7.102; Let A 



1 3 3 
1 1 
-1 1 2 



. a) What are the eigenvalues? b) What is/are the defect(s) of the 



eigenvalue(s)? c) Find the general solution ofx' = Ax. 



Exercise 3.7.103: Let A = 



2 
-1 -1 9 
0-15 



. a) What are the eigenvalues? b) What is/are the defect(s) of 



the eigenvalue(s)? c) Find the general solution ofx' = Ax. 

Exercise 3.7.104; Let A = [ ^ ^ ]- where a, b, and c are unknowns. Suppose that 5 is a doubled 
eigenvalue of defect 1, and suppose that [q] is the eigenvector Find A and show that there is only 
one solution. 
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3.8 Matrix exponentials 

Note: 2 lectures, §5.5 in [EP], §7.7 in [BD] 



3.8.1 Definition 

In this section we present a different way of finding the fundamental matrix solution of a system. 
Suppose that we have the constant coefficient equation 

x' = Fx, 

as usual. Now suppose that this was one equation {P is a number or a 1 x 1 matrix). Then the 
solution to this would be 

^ pt 
X = e . 

It turns out the same computation works for matrices when we define e^' properly. First let us write 
down the Taylor series for e"' for some number a. 



{atf {atf {atf -A {atf 



Kui) \au \un v^' 
e- = l+ at+ — — + + — — + •■•=> , . 
2 6 24 

Recall k\ = 1 ■ 2 ■ 3 ■ ■ - kis the factorial, and 0! = 1 . We diff"erentiate this series term by term 

d , an 2 a^t^ a^t^ /i {at? \ at 

— (e ) = a + a t+ — - + -— + ■ ■■ = a\l + at + — — + -—- + • ■ • = ae . 
dt 2 6 \ 2 6 / 

Maybe we can try the same trick with matrices. Suppose that for annxn matrix A we define the 
matrix exponential as 



e 



= I + A + -A^ + -A^ + • ■ ■ + —A'' + ■ 
2 6 kl 



Let us not worry about convergence. The series really does always converge. We usually write Pt 
as tP by convention when P is a matrix. With this small change and by the exact same calculation 
as above we have that 

dt ^ ' 

Now P and hence e'^ is an « x n matrix. What we are looking for is a vector. We note that in the 
1x1 case we would at this point multiply by an arbitrary constant to get the general solution. In the 
matrix case we multiply by a column vector c. 

Theorem 3.8.1. Let P be an n x n matrix. Then the general solution to x = Pxis 

-> tP-> 
X = e c. 



where c is an arbitrary constant vector. In fact x{Q) = c. 
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Let us check. 

dt dt^ ' 

Hence e'^ is the fundamental matrix solution of the homogeneous system. If we find a way 
to compute the matrix exponential, we will have another method of solving constant coefficient 
homogeneous systems. It also makes it easy to solve for initial conditions. To solve x = Ax, 
x(0) = b, we take the solution 

This equation follows because e"^ = /, so x(0) = e''^^b = b. 

We mention a drawback of matrix exponentials. In general e^'^^ + e^e^ . The trouble is that 
matrices do not conmiute, that is, in general AB 4^ BA. If you try to prove e^^^ 4^ e^e^ using the 
Taylor series, you will see why the lack of commutativity becomes a problem. However, it is still 
true that if AB = BA, that is, if A and B commute, then e^"^® = e^e^. We will find this fact useful. 
Let us restate this as a theorem to make a point. 

Theorem 3.8.2. IfAB = BA, then e^*^ = e^e^. Otherwise e^^^ 4 e^e^ in general. 



3.8.2 Simple cases 

In some instances it may work to just plug into the series definition. Suppose the matrix is diagonal. 
For example, D = [q Then 

^ "[o mJ' 

and 

e^ = I + D+ -D^ + -D^ + ■■■ 

2 6 

So by this rationale we have that 



e' = 



1 







a 





1 







1 


a' 







e" 





1 


+ 





b 


^2 





b^ 


"6 





b' 


+ • • • = 


e'' 



e 
e 



and 



e"' = 



e" 
e« 



This makes exponentials of certain other matrices easy to compute. Notice for example that the 
matrix A = [ f ] can be written as 3/ + 5 where 5 = [ 4? ]• Notice that 5^ = [ {j [j ]. So = 
for all k > 2. Therefore, = I + B. Suppose we actually want to compute e'^. The matrices 3tl 



and tB commute (exercise: check this) and e'^ 

(I + tB) = 



I + tB, since (tBy = t^B^ = 0. We write 



_ ^3tI+tB _ ^3tI^tB 









^3t 



n'it 









„3f 



\ + 2t At 
-t l-2t 



(l+2t)e 
-te^' 



3t 



4te^' 
(l-2t)e^' 
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So we have found the fundamental matrix solution for the system x' = Ax. Note that this matrix has 
a repeated eigenvalue with a defect; there is only one eigenvector for the eigenvalue 3. So we have 
found a perhaps easier way to handle this case. In fact, if a matrix A is 2 x 2 and has an eigenvalue 
A of multiplicity 2, then either A is diagonal, or A = AI + B where = 0. This is a good exercise. 

Exercise 3.8.1; Suppose that A is 2x2 and A is the only eigenvalue. Then show that (A - Alf' = 0. 
Then we can write A = AI + B, where B^ = 0. Hint: First write down what does it mean for the 
eigenvalue to be of multiplicity 2. You will get an equation for the entries. Now compute the square 
ofB. 

Matrices B such that 5* = for some k are called nilpotent. Computation of the matrix 
exponential for nilpotent matrices is easy by just writing down the first k terms of the Taylor series. 

3.8.3 General matrices 

In general, the exponential is not as easy to compute as above. We usually cannot write a matrix as 
a sum of commuting matrices where the exponential is simple for each one. But fear not, it is still 
not too difficult provided we can find enough eigenvectors. First we need the following interesting 
result about matrix exponentials. For two square matrices A and B, with B invertible, we have 

eBAB-' = Be^'B-K 

This can be seen by writing down the Taylor series. First note that 

{BAB'^f = BAB'^BAB'^ = BAIAB'^ = BA^B'K 

And hence by the same reasoning {BAB~^)'^ = BA^B~^. Now write down the Taylor series for e^^^ \ 

^BAB-i Qj^Q-i ^ hsAB-^f + \{BAB-^f + ■■■ 
2 6 

= BB-^ + BAB'^ + -BA^B'^ + -BA^B'^ + • • • 
2 6 

= B{I + A + \a^ + \a^ + ■■■ )B-^ 
2 6 

= Be^B'K 

Given a square matrix A, we can sometimes write A = EDE \ where D is diagonal and E 
invertible. This procedure is called diagonalization. If we can do that, the computation of the 
exponential becomes easy. Adding t into the mix we see that we can then easily compute the 
exponential 

e'^ = Ee'^E-'. 

To diagonalize A we will need n linearly independent eigenvectors of A. Otherwise this method 
of computing the exponential does not work and we need to be trickier, but we will not get into such 



132 



CHAPTER 3. SYSTEMS OF ODES 



details. We let E be the matrix with the eigenvectors as columns. Let Ai, . . . , /l„ be the eigenvalues 
and let vi , . . . , v„ be the eigenvectors, then E = [vi V2 ■ ■ • v,i ] . Let D be the diagonal matrix 
with the eigenvalues on the main diagonal. That is 



D = 



Ai 
Ai 








A„ 



We compute 



AE 



= [^iVi 
= [Vi 

= ED. 



V2 ■ 

A^2 
A2V2 



V2 



Vn] 

• • ^nVn ] 
Vn]D 



The columns of E are linearly independent as these are linearly independent eigenvectors of A. 
Hence E is invertible. Since AE = ED, we right multiply by E'^ and we get 



A = EDE-\ 



This means that = Ee^E ^ . Multiplying the matrix by t we obtain 







•• 


• 




e'^ = Ee'^'E-' = E 







• 


E-\ 







•• 







The formula (3.4) , therefore, gives the formula for computing the fundamental matrix solution e 
for the system x' = Ax, in the case where we have n linearly independent eigenvectors. 

Notice that this computation still works when the eigenvalues and eigenvectors are complex, 
though then you will have to compute with complex numbers. It is clear from the definition that if 
A is real, then e'^ is real. So you will only need complex numbers in the computation and you may 
need to apply Euler's formula to simplify the result. If simplified properly the final matrix will not 
have any complex numbers in it. 

Example 3.8.1: Compute the fundamental matrix solution using the matrix exponentials for the 
system 



X 




1 


2 




X 


y_ 




2 


1 
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Then compute the particular solution for the initial conditions x(Q) - 4 and y(0) = 2. 

Let A be the coefficient matrix [21]- We first compute (exercise) that the eigenvalues are 3 and 
-1 and corresponding eigenvectors are [ } ] and [ _\ ]. Hence we write 



1 1 
1 -1 

1 1 
1 -1 



-1 

T 
-1 

T 





„3t 











-e" - e-' 



1 1 
1 -1 

-1 



2 

-1 -1 
-1 1 



The initial conditions are jc(0) = 4 and j(0) = 2. Hence, by the property that e^^ = / we find that 
the particular solution we are looking for is e'^b where ^ is [ 2]. Then the particular solution we are 
looking for is 



X 









, 2 

e^'-e-' 



, 2 



2e^' + 2e-' + e^' 



2e 



3t 



2e-' + e^* + e-' 





3e^' + e'*' 




3^3' - e-' 



3.8.4 Fundamental matrix solutions 

We note that if you can compute the fundamental matrix solution in a different way, you can use 
this to find the matrix exponential e'"^. The fundamental matrix solution of a system of ODEs is 
not unique. The exponential is the fundamental matrix solution with the property that for ? = 
we get the identity matrix. So we must find the right fundamental matrix solution. Let X be any 
fundamental matrix solution to x' = Ax. Then we claim 

e'"^ = X(t) [X{0)r^ . 

Clearly, if we plug t = into X{t) [X{0)y^ we get the identity. We can multiply a fundamental 
matrix solution on the right by any constant invertible matrix and we still get a fundamental matrix 
solution. All we are doing is changing what the arbitrary constants are in the general solution 

f(0 = x(0?. 



3.8.5 Approximations 

If you think about it, the computation of any fundamental matrix solution X using the eigenvalue 
method is just as diflftcult as the computation of e'^. So perhaps we did not gain much by this 
new tool. However, the Taylor series expansion actually gives us a very easy way to approximate 
solutions, which the eigenvalue method did not. 
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The simplest thing we can do is to just compute the series up to a certain number of terms. There 
are better ways to approximate the exponential*. In many cases however, few terms of the Taylor 
series give a reasonable approximation for the exponential and may suffice for the application. For 
example, let us compute the first 4 terms of the series for the matrix A = [ 2 f ]• 



e'^ Kl + tA + -A^ + -A^ 
2 6 



I + t 



1 2 

2 1 



5 2 
2 ^ 



13 7 1 

6 3 

1 13 

3 6 



1 + ? + i ^2 + ^ ^3 

2 6 

2t + 2t^ + 



2? + 2?2 + Z^3 1 



Just like the scalar version of the Taylor series approximation, the approximation will be better for 
small t and worse for larger t. For larger t, we will generally have to compute more terms. Let us see 
how we stack up against the real solution with t = OA. The approximate solution is approximately 
(rounded to 8 decimal places) 



„0.1A 



/ + 0.1A + 



0.1^ 



A^ + 



1.12716667 0.22233333 
0.22233333 1.12716667 



2 6 

And plugging t = Q.l into the real solution (rounded to 8 decimal places) we get 



0.1 A 



1.12734811 0.22251069 
0.22251069 1.12734811 



Not bad at all! Although if we take the same approximation for ? = 1 we get 



I + A + -A^ + -A^ = 
2 6 



6.66666667 6.33333333 
6.33333333 6.66666667 



while the real value is (again rounded to 8 decimal places) 



10.22670818 9.85882874 
9.85882874 10.22670818 



So the approximation is not very good once we get up to ? = 1 . To get a good approximation at 
t = \ (say up to 2 decimal places) we would need to go up to the 1 1'*^ power (exercise). 



3.8.6 Exercises 

Exercise 3.8.2; Using the matrix exponential, find a fundamental matrix solution for the system 
x' = 3x + y, y = X + 3y. 

*C. Moler and C.F. Van Loan, Nineteen Dubious Ways to Compute the Exponential of a Matrix, Twenty-Five Years 
Later, SIAM Review 45 (1), 2003, 3-49 
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Exercise 3.8.3; Find e'^ for the matrix A = [ q ^ ]. 

Exercise 3.8.4; Find a fundamental matrix solution for the system x\ = 7xi + 4x2 + 12^3, x'2 = 
Xi + 2X2 + - 2x2 - 5x3. Then find the solution that satisfies x 




1 

-2 



Exercise 3.8.5; Compute the matrix exponential e^ for A = 

Exercise 3.8.6 (challenging); Suppose AB = BA. Show that under this assumption, e^^^ = e^e^. 

Exercise 3.8.7; Use Exercise 3.8.6 to show that (e^) ^ = e'^. In particular this means that e^ is 
invertible even if A is not. 

Exercise 3.8.8; Suppose A is a matrix with eigenvalues -1, 1, and corresponding eigenvectors [ j ], 
[ J ]. a) Find matrix A with these properties, b) Find the fundamental matrix solution to x' = Ax. c) 
Solve the system in with initial conditions x(0) = [ 3 ] • 

Exercise 3.8.9; Suppose that A is an nx n matrix with a repeated eigenvalue A of multiplicity n. 
Suppose that there are n linearly independent eigenvectors. Show that the matrix is diagonal, in 
particular A = AI. Hint: Use diagonalization and the fact that the identity matrix commutes with 
every other matrix. 

Exercise 3.8.10; LetA = [ ]. a) Find e'^. b) Solve x = Ax, f(0) = [ ^2 ]• 

Exercise 3.8.11; Let A = Approximate e'^ by expanding the power series up to the third 

order 

Exercise 3.8.101; Compute e'^ where A = ~i ]. 
Exercise 3.8.102; Compute e'^ where A 

Exercise 3.8.103; a) Compute e'^ where A = {\'^]. b) Solve x' = Ax for xifS) = [ 2 ]• 

Exercise 3.8.104; Compute the first 3 terms {up to the second degree) of the Taylor expansion of 
e'^ where A = [H] (Write as a single matrix). Then use it to approximate e^'^^. 



1 -3 2 
-2 1 2 

-1 -3 4 
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3.9 Nonhomogeneous systems 

Note: 3 lectures (may have to skip a little), somewhat different from §5.6 in [EPJ, §7.9 in [BP] 

3.9.1 First order constant coefficient 

Integrating factor 

Let us first focus on the nonhomogeneous first order equation 



where A is a constant matrix. The first method we will look at is the integrating factor method. For 
simplicity we rewrite the equation as 



where P = -A. We multiply both sides of the equation by e (being mindful that we are dealing 
with matrices that may not commute) to obtain 



We notice that Pe = e P. This fact follows by writing down the series definition of e , 



f'a) = Af(o + m 



r(t) + pm = M 



e'^^'it) + e^'PAt) = e"'fit). 




1 7 ^ 

-t^p^ + ■■■ = 

2 




We have already seen that j (e'^l = Pe"'. Hence, 





We can now integrate. That is, we integrate each component of the vector separately 




Recall from Exercise 3.8.7 that {e ) 



= e . Therefore, we obtain 
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Perhaps it is better understood as a definite integral. In this case it will be easy to also solve for 
the initial conditions as well. Suppose we have the equation with initial conditions 

x'it) + Px{t) = fit), f(0) = b. 
The solution can then be written as 



Jo 



(3.5) 



Again, the integration means that each component of the vector e^^fis) is integrated separately. It is 

-> 

not hard to see that (3.5) really does satisfy the initial condition x{0) = b. 



x(0) = e 



-OP 



f 

Jo 



e'^fis) ds + e'^^b = lb = b. 



Example 3.9.1: Suppose that we have the system 



x^ + 5^1 — 3x2 — ^\ 
X2 + 3xi — X2 — 0, 



with initial conditions xi(0) = 1, ^2(0) = 0. 
Let us write the system as 



X + 



5 -3 
3 -1 



X 



We have previously computed e'^ for P = [ 3 _j ]. We immediately have e simply by negating t. 



3te^' i\-3t)e^' 



6-"" = 



(l-3t)e-^' 3te-^' 
-3te-^' i\+3t)e'^' 



Instead of computing the whole formula at once. Let us do it in stages. First 



r e''fis)ds= [ 
Jo Jo 

-f 

Jo 



{\+3s)e^' -3se'' 
3se^' (1-35)^2^ 

{\+3s)e^' 



ds 



3se 



3 s 



ds 



te 
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Then 



x(t) 



-tp 



Jo 



f ls) ds + e-'^'h 



(1 - 30 3?e-2' 
-3fe-2^ (l + 30e-2' 
It 

It 











(3f-l)<;3'+l 


+ 




L 3 J 





1 




te' 



+ 



Phew! 

Let us check that this really works. 



(1-30^-2' 



x\ + 5xi - 3x2 = {^te-" - 4e-'') + 5(1 - 2t) e'" + e' - (I - 6t) e'^' = e' 



Similarly (exercise) + 3x\ - X2 = 0. The initial conditions are also satisfied as well (exercise). 

For systems, the integrating factor method only works if P does not depend on t, that is, P is 
constant. The problem is that in general 

because matrix multiplication is not commutative. 



Eigenvector decomposition 

For the next method, we note that eigenvectors of a matrix give the directions in which the matrix 
acts like a scalar. If we solve our system along these directions these solutions would be simpler as 
we can treat the matrix as a scalar. We can put those solutions together to get the general solution. 
Take the equation 

f'(0=Af(0 + /(0. (3.6) 
Assume that A has n linearly independent eigenvectors vi, . . . , v„- Let us write 

f(o = ^1 m + ^2 m +---+^n ut). (3.7) 

That is, we wish to write our solution as a linear combination of eigenvectors of A. If we can solve 
for the scalar functions through ^„ we have our solution x. Let us decompose / in terms of the 
eigenvectors as well. Write 



fit) = gi(0 + giit) + • • • + v„ g„{t). 



(3.8) 
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That is, we wish to find through g„ that satisfy (3.8) . We note that since all the eigenvectors are 
independent, the matrix E = [vi V2 • • • v„ ] is invertible. We see that (3.8) can be written as 
f = Eg, where the components of g are the functions through g„. Then g = E f. Hence it is 
always possible to find g when there are n linearly independent eigenvectors. 
We plug (3.7) into (3.6) , and note that Avk = AkV^. 

= A (Vi ^1 + V2 ^2 + • • ■ + V„ ^n) + Vigi+V2g2 + ■•• +Vngn 
= AVi ^1 + AV2 ^2 + • • • + AVn ^n+Vigi+V2g2 + ■■■ + V„ gn 
= Vi /ll ^1 + V2 /I2 6 + ■ • ■ + Vn An^n+Vigi+V2g2 + ■■■ + Vn gn 
= Vi {Ai ^1 + gl) + V2 {A2 ^2 + ,?2) + • ■ • + V„ {An + gn)- 

If we identify the coefficients of the vectors vi through v„ we get the equations 

^'2 = A2^2+g2, 



^'n = An^n+gn- 

Each one of these equations is independent of the others. They are all linear first order equations 
and can easily be solved by the standard integrating factor method for single equations. That is, for 
example for the /r* equation we write 

m-^km = gk{t). 

We use the integrating factor e"'^*' to find that 

j-j^u{t)e-'''] = e-'''gu{t). 
Now we integrate and solve for to get 

Ut) = e''^' ^ e-'''gu{t) dt + Cue'". 

Note that if we are looking for just any particular solution, we could set Ck to be zero 
these constants in, we will get the general solution. Write x{t) = vi ^i{t) + V2^2(0 + 
and we are done. 

Again, as always, it is perhaps better to write these integrals as definite integrals. Suppose that 
we have an initial condition x(0) = b. We take c = E'^b and note b = vi ai + ■ ■ ■ + v„a„, just like 
before. Then if we write 

a(0 = e'^' [ e-'^'gkis) dt + aue''\ 
Jo 



. If we leave 
• ■ • + v„ ^„(0, 
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we will actually get the particular solution x(t) = vi^i(0 + V2^2(0 + • • • + v„^n(t) satisfying ;c(0) = b, 
because ^yt(O) = iik- 

Example 3.9.2: Let A = [ i ^ ] . Solve f = Af + /where f(t) = [ X ] for f (0) = [ _%\^6 ] . 

The eigenvalues of A are -2 and 4 and corresponding eigenvectors are [ _\ ] and [ } ] respectively. 
This calculation is left as an exercise. We write down the matrix E of the eigenvectors and compute 
its inverse (using the inverse formula for 2 x 2 matrices) 



1 1 
-1 1 



1 -1 
1 1 



We are looking for a solution of the form j? = [ Ji ] + [ } ] ^2- We also wish to write / in terms 
of the eigenvectors. That is we wish to write / = [ |f j = [ _\ ] gi + [ } ] g2- Thus 



^1 


= E-' 


le' 


1 


1 


-1 




le' 




e' - 1 






It 


~ 2 


1 


1 




It 




e' + 1 



So ^1 = e' -t and g2 = e' + t. 

We further want to write x(0) in terms of the eigenvectors. That is, we wish to write ;c(0) = 
[-57f6] = [-i]«i + [l]«2. Hence 





= E-' 


' 3/16 ^ 




' V4" 






-5/16 




-1/16 



So a\ = 1/4 and a2 = ~yi6. We plug our into the equation and get that 

82 



1 




1 




1 


^1+A 


1 


6 + 


1 




1 


-1 




1 


^2=A 


-1 


1 


-1 


^1 + 


1 



1 

-1 



We get the two equations 

^[ = -2^i+e'-t, 
^'2 = 4^2 + e' + t. 



(-2^1) + 



4^2 + 



1 

-1 



(e' -t) + 



{e'-t). 



where ^i(O) = ai = -, 



where ^2(0) = a2 = 



16 



We solve with integrating factor. Computation of the integral is left as an exercise to the student. 
Note that we will need integration by parts. 



^1 =e-2' J e"{e' -t)dt + C,e-^' = ^--l^ + ^+C,i 



,-2f 
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C\ is the constant of integration. As ^i(O) = V^, then 1/4 = 1/3 + 74 + Ci and hence Ci = -1/3. 
Similarly 

^2 = e" J e-" (e' + t) dt + C^e'^ = -^-1-1 + C^e" . 
As ^2(0) = V16 we have that -1/16 = ~V3 - V16 + ^2 and hence C2 = Vs. The solution is 



m = 



1 

-1 



e' - e-^' 1 - 2t 
: + -. — 



+ 



At 



e' 4t+l 



16 



'"-e-^' , 3-12? 

3 16 
''+e'^'+2e' . 4t-5 



+ 



16 



That is, xi 



3-12? 
16 



and X2 



3 16 • 



Exercise 3.9.1; Check that xi and X2 solve the problem. Check both that they satisfy the differential 
equation and that they satisfy the initial conditions. 

Undetermined coefficients 

We also have the method of undetermined coefficients for systems. The only difference here is that 
we will have to take unknown vectors rather than just numbers. Same caveats apply to undetermined 
coefficients for systems as for single equations. This method does not always work. Furthermore if 
the right hand side is complicated, we will have to solve for lots of variables. Each element of an 
unknown vector is an unknown number. So in system of 3 equations if we have say 4 unknown 
vectors (this would not be uncommon), then we already have 12 unknown numbers that we need to 
solve for. The method can turn into a lot of tedious work. As this method is essentially the same as 
it is for single equations, let us just do an example. 

Example 3.9.3: Let A = [ :^ ? ]. Find a particular solution of x' = Ax + f where /(O = [ i j- 

Note that we can solve this system in an easier way (can you see how?), but for the purposes of 

the example, let us use the eigenvalue method plus undetermined coefficients. 

The eigenvalues of A are -1 and 1 and corresponding eigenvectors are [ | ] and [ 5 ] respectively. 

Hence our complementary solution is 





1 









1 


e ' + a2 


1 



for some arbitrary constants ai and a2. 

We would want to guess a particular solution of 



X 



de' + bt + c. 



However, something of the form ae' appears in the complementary solution. Because we do not 
yet know if the vector a is a multiple of [ j ], we do not know if a conflict arises. It is possible that 
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there is no conflict, but to be safe we should also try bte'. Here we find the crux of the difli'erence for 
systems. We try both terms ae' and bte' in the solution, not just the term bte'. Therefore, we try 

x = de' + bte' + ct + d. 

Thus we have 8 unknowns. We write 5 = [ ], ^ = [ ], c = [ ], and [ ]. We plug f into the 
equation. First let us compute x'. 

x = (a + b)e' + bte' + c 

Now X must equal Ax + /, which is 
Ax + f= Ade' + Abte' + + a/+ /= 



a\ + b\ 


e' + 


bi 


te' + 




aj + b2 




b2 







—ai 
—2ai + a2 



e' + 



-2bi + b2 



te' 



-Cl 
-2ci + C2 



t + 



-di 
—2di + d2 



+ 



e' + 



We identify the coefficients of e', te', t and any constant vectors. 

a\ + b\ = -ai + 1, 
«2 + ^2 = -2ai + a2, 

bi = -bu 

b2 = -2bi + b2, 
= -Cl, 

= -2ci +C2 + 1, 
Cl = -di, 
C2 = -2di + d2. 

We could write the 8 x 9 augmented matrix and start row reduction, but it is easier to just solve the 
equations in an ad hoc manner. Intunediately we see that bi = 0, ci = 0, di = 0. Plugging these 
back in, we get that C2 = -1 and J2 = -1- The remaining equations that tell us something are 

a\ = —a\ + 1, 
«2 + ^2 = -2a\ + a2. 

So ai = V2 and b2 = -1. Finally, 02 can be arbitrary and still satisfy the equations. We are looking 
for just a single solution so presumably the simplest one is when a2 = 0. Therefore, 



x = de' + bte' + ^t + d = 



1/2 






















e' + 


-1 


te' + 


-1 


t + 


-1 









^e' 

2 



-te' -t-l 



That is, Xi = ^ e', X2 = -te' -t-l. We would add this to the complementary solution to get the 
general solution of the problem. Notice also that both ae' and bte' were really needed. 
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Exercise 3.9.2; Check that xi and X2 solve the problem. Also try setting a2 = I and again check 
these solutions. What is the difference between the two solutions we can obtain in this way? 

As you can see, other than the handling of conflicts, undetermined coefficients works exactly the 
same as it did for single equations. However, the computations can get out of hand pretty quickly 
for systems. The equation we had done was very simple. 



3.9.2 First order variable coefficient 

Just as for a single equation, there is the method of variation of parameters. In fact for constant 
coefficient systems, this is essentially the same thing as the integrating factor method we discussed 
earlier. However, this method will work for any linear system, even if it is not constant coefficient, 
provided we can somehow solve the associated homogeneous problem. 
Suppose we have the equation 

X =A{t)x + f{t). (3.9) 

Further, suppose that we have solved the associated homogeneous equation x' = A(t)x and found 
the fundamental matrix solution X{t). The general solution to the associated homogeneous equation 
is X{t)c for a constant vector c. Just like for variation of parameters for single equation we try the 
solution to the nonhomogeneous equation of the form 

Xp = X{t) ii(t), 

where ii(t) is a vector valued function instead of a constant. Now we substitute into (3.9) to obtain 

Xp{t) = X'(t) u{f) + X{t) U'{t) = A{t) X{t) Hit) + fit). 

ButX(t) is the fundamental matrix solution to the homogeneous problem, so X'(t) = A(t)X(t), and 

X'it) Hit) + Xit) u'it) = X'it) uit) + fit). 

Hence Xit) it' it) = fit). If we compute [Xit)]~\ then il'it) = [Xit)]~^ fit). We integrate to obtain iJ 
and we have the particular solution Xp = Xit) ilit). Let us write this as a formula 



^p=Xit) \Xit)r fit)dt. 



Note that if A is constant and we let Xit) = e , then [Xit)] = e and hence we get a solution 
Xp = e'^ J e~'^ fit) dt, which is precisely what we got using the integrating factor method. 



Example 3.9.4: Find a particular solution to 

1 



t 


-1 




t 


1 






1 


t 



(3.10) 
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Here A = ^ [ i "/ ] is most definitely not constant. Perhaps by a lucky guess, we find that 
X = [ } solves X'{t) = A{t)X{t). Once we know the complementary solution we can easily find a 
solution to (3.10). First we find 



1 t 
-t 1 



Next we know a particular solution to (3.10) is 

^p = x{t) J [x(t)r'f(t) dt 



1 -t 

t 1 

1 -t 

t 1 

1 -t 

t 1 

It'+t 



1 t 
-t 1 



{t^ + 1) dt 



2t 
-t^ + \ 



dt 



-\t' + t 



Adding the complementary solution we have that the general solution to (3.10). 



X 



1 -t 
t 1 



+ 



i *4 

3 



C2 + (Ci + l)t+lt^ 



Exercise 3.9.3; Check that xi = ^t'^ and X2 = \t^ + t really solve (3.10) . 

In the variation of parameters, just like in the integrating factor method we can obtain the general 
solution by adding in constants of integration. That is, we will add X{t)c for a vector of arbitrary 
constants. But that is precisely the complementary solution. 



3.9.3 Second order constant coefficients 
Undetermined coefficients 

We have already seen a simple example of the method of undetermined coefficients for second order 
systems in § 3.6. This method is essentially the same as undetermined coefficients for first order 
systems. There are some simphfications that we can make, as we did in § 3.6. Let the equation be 

x" =Ax + P{t), 

where A is a constant matrix. If F{t) is of the form Fq cos(a)0, then as two derivatives of cosine is 
again cosine we can try a solution of the form 



Xp = ccos(a»0, 
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and we do not need to introduce sines. 

If the F is a sum of cosines, note that we still have the superposition principle. If F(t) = 
Focos(a»o0 + Fi cos(cuiO, then we would try flcos(a»oO for the problem x" = Ax + Fq cos(a;o05 
and we would try bcos(coit) for the problem x" = Ax + Pq cos(a)iO- Then we sum the solutions. 

However, if there is duplication with the complementary solution, or the equation is of the form 
x" = Ax' + Bx + F{t), then we need to do the same thing as we do for first order systems. 

You will never go wrong with putting in more terms than needed into your guess. You will find 
that the extra coefficients will turn out to be zero. But it is useful to save some time and effort. 

Eigenvector decomposition 

If we have the system 

x" =Ax + F(t), 

we can do eigenvector decomposition, just like for first order systems. 

Let /li, . . . , /l„ be the eigenvalues and vi, . . . , v„ be eigenvectors. Again form the matrix 
£■ = [ Vi ■ • • v„ ] . We write 

X{t) = Vi ^i(t) + V2 6(0 + ■ • • + Vn 6(0- 

We decompose F in terms of the eigenvectors 

F(t) = Vi gi(t) + V2 glit) + • • • + V„ gn{t). 

And again g = E~^F. 

Now we plug in and doing the same thing as before we obtain 

X = Vi^i +V2^2 + + 

= A (Vi ^1 + V2 6 + • • • + Vn ^n) + Vigi+V2g2 + ■■■ + Vn gn 
= AVi ^1 + AV2 6 + • • ■ + AV„ ^n+Vigi + V2g2 + ■ ■ ■ + V„ gn 
= Vi /ll ^1 + V2 6 + ■ • ■ + V„ An 6 + Vi + V2 ^2 + ■ ■ • + V„ gn 
= Vi (^1 ^1 + ^i) + V2 (/I2 6 + ^2) + • • • + Vn (An ^ + gn)- 

We identify the coefficients of the eigenvectors to get the equations 

^2 = h^2+g2, 
~ + Sn ■ 

Each one of these equations is independent of the others. We solve each equation using the methods 
of chapter 2. We write x{t) = v\^i{t) + ■ ■ ■ + Vn ^n{t), and we are done; we have a particular solution. 

If we have found the general solution for ^1 through 6, then again x{t) = v\^\{t)-\ + v„ ^„{t) is 

the general solution (and not just a particular solution). 
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Example 3.9.5: Let us do the example from § 3.6 using this method. The equation is 

cos(30- 



X = 



-3 1 







2 -2 




2 



The eigenvalues were -1 and -4, with eigenvectors [2] and Therefore E = [2-1] and 

3 



= Hi-il Therefore, 



1 


1 1 







' 1 cos(30 ' 


3 


2 -1 


2 cos(30_ 




y cos(30 



,^1 

So after the whole song and dance of plugging in, the equations we get are 

r; = -^i + ^cos(3o, 

^2 =-46-^cos(30. 

For each we can try the method of undetermined coefficients and try Ci cos(30 for the first equation 
and C2 cos(30 for the second equation. We plug in to get 



-9Ci cos(30 = -Ci cos(30 + - cos(30, 

2 

-9C2Cos(30 = -4C2Cos(30 - -cos(30. 

Each of these equations we solve separately. We get -9Ci = -Ci + 2/3 and -9C2 = -4C2 - y^. And 
hence Ci = ~Vi2 and C2 = yi5. So our particular solution is 



X 



1 

T2 



cos(30 + 



1 

-1 



15 



cos(30 = 



1/20 
-3/10 



cos(30- 



This solution matches what we got previously in § 3.6. 



3.9.4 Exercises 

Exercise 3.9.4; Find a particular solution to x' = x + 2y + 2t, y' = 3x + 2y - 4, a) using integrating 
factor method, b) using eigenvector decomposition, c) using undetermined coefficients. 

Exercise 3.9.5; Find the general solution to x' = 4x + y - 1, y' = x + 4y - e', a) using integrating 
factor method, b) using eigenvector decomposition, c) using undetermined coefficients. 

Exercise 3.9.6; Find the general solution to x" = -6x\ + 3x2 + cos(0, x'^ = 2x\ - 1x2 + 3 cos(0, ci) 
using eigenvector decomposition, b) using undetermined coefficients. 
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Exercise 3.9.7; Find the general solution to x'[ - -6xi + 3x2 + cos(20, ^2 ~ ^-^i ~ ^•'^2 + 3 cos(2?), 
a) using eigenvector decomposition, b) using undetermined coefficients. 

Exercise 3.9.8; Take the equation 

t^' 
-t 

a) Check that 





t sinf 




t COS t 




-t cos t 




t sin? 



is the complementary solution, b) Use variation of parameters to find a particular solution. 

Exercise 3.9.101; Find a particular solution to x' = 5x + 4-y + 1, y' = x + Sy - 1, a) using integrating 
factor method, b) using eigenvector decomposition, c) using undetermined coefficients. 

Exercise 3.9.102; Find a particular solution to x' = y + e', y' = x + e*, a) using integrating factor 
method, b) using eigenvector decomposition, c) using undetermined coefficients. 

Exercise 3.9.103; Solve x[ = X2 + t, x!2 = x\ + t with initial conditions xi(0) = 1, X2(0) = 2, using 
eigenvector decomposition. 

Exercise 3.9.104; Solve x'/ = —3>Xi+X2 + t, x^' = 9x\ +5x2 + cos(0 with initial conditions xi(0) = 0, 
X2(0) = 0, x'^(O) = 0, x^(0) = 0, using eigenvector decomposition. 



-^1 

X = 



-1 

1 

t J 



x + 
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Chapter 4 



Fourier series and PDEs 



4.1 Boundary value problems 

Note: 2 lectures, similar to §3.8 in [EPJ, §10.1 and §11.1 in [BD] 

4.1.1 Boundary value problems 

Before we tackle the Fourier series, we need to study the so-called boundary value problems (or 
endpoint problems). For example, suppose we have 

x" + Ax = 0, x(a) = 0, x(b) = 0, 

for some constant A, where x{t) is defined for t in the interval [a,b]. Unlike before, when we 
specified the value of the solution and its derivative at a single point, we now specify the value of 
the solution at two different points. Note that x = is a solution to this equation, so existence of 
solutions is not an issue here. Uniqueness of solutions is another issue. The general solution to 
x" + Ax = has two arbitrary constants present. It is, therefore, natural (but wrong) to believe that 
requiring two conditions guarantees a unique solution. 

Example 4.1.1: Take A= 1, a = 0, b = n. That is, 

x" + x = 0, x(0) = 0, x(n) = 0. 

Then x = s'mt is another solution (besides x = 0) satisfying both boundary conditions. There are 
more. Write down the general solution of the differential equation, which is x = A cos t + Bsin t. 
The condition x{0) = forces A = 0. Letting x(n) = does not give us any more information as 
X = Bsint already satisfies both boundary conditions. Hence, there are infinitely many solutions of 
the form x = Bs'm t, where B is an arbitrary constant. 
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Example 4.1.2: On the other hand, change to A = 2. 

x" + 2jc = 0, jc(0) = 0, x{n) = 0. 

Then the general solution is x = Acos(V2f) + Bsm(y/2t). Letting x(0) = still forces A = 0. We 
apply the second condition to find = x(n) = B sm(y/2n). As sin(V2;7r) we obtain 5 = 0. 
Therefore x = is the unique solution to this problem. 

What is going on? We will be interested in finding which constants A allow a nonzero solution, 
and we will be interested in finding those solutions. This problem is an analogue of finding 
eigenvalues and eigenvectors of matrices. 

4.1.2 Eigenvalue problems 

For basic Fourier series theory we will need the following three eigenvalue problems. We will 
consider more general equations, but we will postpone this until chapter 5. 

x" + Ax = 0, x(a) = 0, x(b) = 0, (4.1) 

x" + Ax = 0, x'ia) = 0, x'ib) = 0, (4.2) 

and 

x" + Ax = 0, x(a) = x(b), x'(a) = x'(b), (4.3) 

A number A is called an eigenvalue of (4.1) (resp. (4.2) or (4.3) ) if and only if there exists a nonzero 
(not identically zero) solution to (4.1) (resp. (4.2) or (4.3) ) given that specific A. The nonzero 
solution we found is called the corresponding eigenfunction. 

Note the similarity to eigenvalues and eigenvectors of matrices. The similarity is not just 
coincidental. If we think of the equations as differential operators, then we are doing the same exact 
thing. For example, let L = We are looking for nonzero functions / satisfying certain endpoint 
conditions that solve (L - A)f = 0. A lot of the formalism from linear algebra can still apply here, 
though we will not pursue this line of reasoning too far. 

Example 4.1.3: Let us find the eigenvalues and eigenfunctions of 

x" + Ax = Q, x{Q) = 0, x(n) = 0. 

For reasons that will be clear from the computations, we will have to handle the cases A > 0, 
A = 0, A < separately. First suppose that A > 0, then the general solution to x" + Ax = is 

x = A cos(Vi t) + B sin(Vi 0- 

The condition x{0) = imphes immediately A = 0. Next 

= x{n) = Bsm(^fA7T). 
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If B is zero, then x is not a nonzero solution. So to get a nonzero solution we must have that 
sin(V^;7r) = 0. Hence, y/An must be an integer multiple of n. In other words, = k for a 
positive integer k. Hence the positive eigenvalues are k^ for all integers k> I. The corresponding 
eigenfunctions can be taken as x = sin(^0- Just like for eigenvectors, we get all the multiples of an 
eigenfunction, so we only need to pick one. 

Now suppose that A = O.ln this case the equation is x" = and the general solution i& x = At+B. 
The condition x(0) = imphes that B = 0, and x(n) = implies that A = 0. This means that A = 
is not an eigenvalue. 

Finally, suppose that A < O.ln this case we have the general solution 

x = A cosh( t) + B sinh( t). 

Letting x(0) = implies that A = (recall coshO = 1 and sinhO = 0). So our solution must be 
X = B sinh(V^O and satisfy x(n) = 0. This is only possible if B is zero. Why? Because sinh^ is 
only zero when ^ = 0. You should plot sinh to see this fact. We can also see this from the definition 
of sinh. We get = sinh? = ^-y-. Hence e' = e~', which implies t = -t and that is only true if f = 0. 
So there are no negative eigenvalues. 

In summary, the eigenvalues and corresponding eigenfunctions are 

Ak = k^ with an eigenfunction Xk = sm(kt) for all integers ^ > 1 . 

Example 4.1.4: Let us compute the eigenvalues and eigenfunctions of 

x" + Ax = 0, x'(0) = 0, x'in) = 0. 

Again we will have to handle the cases A>0, A = 0, A<0 separately. First suppose that A> 0. 
The general solution to x" + Ax = is x = A cos(VI + ^ sm(^/A t). So 

x' = -A sin(VIO + 5 cos(VIO- 

The condition x'(O) = implies immediately 5 = 0. Next 

= x'(7r) = -A^[A sin(VA7r). 

Again A cannot be zero if A is to be an eigenvalue, and sin(V^7r) is only zero if = ^ for a positive 
integer k. Hence the positive eigenvalues are again k^ for all integers ^ > 1. And the corresponding 
eigenfunctions can be taken as x = cos(fcO- 

Now suppose that /I = 0. In this case the equation is x" = and the general solution i& x - At + B 
so x' = A. The condition x'(0) = implies that A = 0. Now x'{n) = also simply implies A = 0. 
This means that B could be anything (let us take it to be 1). So A = is an eigenvalue and x = 1 is a 
corresponding eigenfunction. 

Finally, let A < O.ln this case we have the general solution x = A cosh( V-^ t) + B sinh( V-^ 
and hence 

x' = A sinh(V^O + B cosh(V^O- 
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We have already seen (with roles of A and B switched) that for this to be zero at ? = and t = n it 
implies that A = B = 0. Hence there are no negative eigenvalues. 

In summary, the eigenvalues and corresponding eigenfunctions are 

Ak = with an eigenfunction Xk = cos(kt) for all integers ^ > 1, 

and there is another eigenvalue 

Aq = with an eigenfunction xq = 1. 

The following problem is the one that leads to the general Fourier series. 

Example 4.1.5: Let us compute the eigenvalues and eigenfunctions of 

x" + Ax = 0, x(-n) = x(7r), x'(-n) = x'(n). 

Notice that we have not specified the values or the derivatives at the endpoints, but rather that they 
are the same at the beginning and at the end of the interval. 

Let us skip A <0. The computations are the same as before, and again we find that there are no 
negative eigenvalues. 

For A = 0, the general solution is x = At + B. The condition x(-n) = x(n) implies that A = 
(An + B = -An + B implies A = 0). The second condition x'{-n) = x'{n) says nothing about B and 
hence /I = is an eigenvalue with a corresponding eigenfunction jc = 1. 

For A > we get that x =A cos( t) + B sin(V^ t). Now 

A cos(- yfAn) + B sin(- VI ;r) = A cos( Va n) + B sin( n). 

We remember that cos(-6) = cos(0) and sin(-6) = - sin(6). Therefore, 

A cos( VI n)-B sin( VI n) = A cos( VI n) + B sin( VI n). 

Hence either 5 = or sin(Vl7r) = 0. Similarly (exercise) if we differentiate x and plug in the 
second condition we find that A = or sin(Vl7r) = 0. Therefore, unless we want A and B to both be 
zero (which we do not) we must have sin(^/An) = 0. Hence, VI is an integer and the eigenvalues 
are yet again A = for an integer k > 1. In this case, however, x = Acos(kt) + Bsin(kt) is an 
eigenfunction for any A and any B. So we have two linearly independent eigenfunctions sin{kt) and 
cos(kt). Remember that for a matrix we could also have had two eigenvectors corresponding to a 
single eigenvalue if the eigenvalue was repeated. 

In summary, the eigenvalues and corresponding eigenfunctions are 

Ak = k^ with the eigenfunctions cos(kt) and sin(A;0 for all integers > 1, 
Aq = with an eigenfunction xq = I. 
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4.1.3 Orthogonality of eigenf unctions 

Something that will be very useful in the next section is the orthogonality property of the eigen- 
functions. This is an analogue of the following fact about eigenvectors of a matrix. A matrix is 
called symmetric if A = . Eigenvectors for two distinct eigenvalues of a symmetric matrix are 
orthogonal. That symmetry is required. We will not prove this fact here. The differential operators 
we are dealing with act much like a symmetric matrix. We, therefore, get the following theorem. 

Theorem 4.1.1. Suppose that xi{t) and X2{t) are two eigenfunctions of the problem (4.1) , (4.2) or 
{A3) for two different eigenvalues Ai and Aj. Then they are orthogonal in the sense that 

I Xi(t)x2(t) dt = 0. 

Note that the terminology comes from the fact that the integral is a type of inner product. We 
will expand on this in the next section. The theorem has a very short, elegant, and illuminating 
proof so let us give it here. First note that we have the following two equations. 

x'{ + AiXi =0 and x'2 + A2X2 = 0. 

Multiply the first by X2 and the second by xi and subtract to get 

(/Ij — A2)X\X2 — X2X\ — X2X^ . 

Now integrate both sides of the equation. 

Jr>b r-b 
X\X2 dt = I XjXi - X2x'l dt 
a J a 



'J a 



— {X2X1 - X2X\) dt 



The last equality holds because of the boundary conditions. For example, if we consider (4.1) we 
have Xi{a) = Xiib) = X2{a) = X2ib) = and so x^Xi - X2x\ is zero at both a and h. As A\ 4^ A2, the 
theorem follows. 

Exercise 4.1.1 (easy); Finish the theorem (check the last equality in the proof) for the cases (4.2) 
and (4.3) . 

We have seen previously that sin(nf) was an eigenfunction for the problem x" + Ax = 0, x{0) = 0, 
x(n) = 0. Hence we have the integral 

sm(mt) sm{nt) dt = 0, when mi^ n. 
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Similarly 

cos(mt) cos(nt) dt = 0, when m n. 



Jo 



And finally we also get 

Xsin(mO sin(nO dt = 0, when m n, 
n 

cos{mt) cos(nf) dt = 0, when m 4^ n, 



and 

cos(mf) sm(nt) dt = 0. 



1: 



4.1.4 Fredholm alternative 

We now touch on a very useful theorem in the theory of differential equations. The theorem holds 
in a more general setting than we are going to state it, but for our purposes the following statement 
is sufficient. We will give a slightly more general version in chapter 5. 

Theorem 4.1.2 (Fredholm alternative^). Exactly one of the following statements holds. Either 

x" + Ax = 0, x{a) = 0, x{b) = (4.4) 

has a nonzero solution, or 



x" + Xx = fit), x(a) = 0, x(b) = (4.5) 
has a unique solution for every function f continuous on [a,b]. 

The theorem is also true for the other types of boundary conditions we considered. The theorem 
means that if A is not an eigenvalue, the nonhomogeneous equation (4.5) has a unique solution for 
every right hand side. On the other hand if A is an eigenvalue, then (4.5) need not have a solution 
for every /, and furthermore, even if it happens to have a solution, the solution is not unique. 

We also want to reinforce the idea here that linear differential operators have much in common 
with matrices. So it is no surprise that there is a finite dimensional version of Fredholm alternative 
for matrices as well. Let A be an n x n matrix. The Fredholm alternative then states that either 
{A - AI)x = has a nontrivial solution, or (A - AI)x = b has a solution for every b. 

A lot of intuition from linear algebra can be applied to linear differential operators, but one 
must be careful of course. For example, one difference we have already seen is that in general a 
differential operator will have infinitely many eigenvalues, while a matrix has only finitely many. 



*Named after the Swedish mathematician Erik Ivar Fredholm (1866 - 1927). 
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4.1.5 Application 

Let us consider a physical application of an endpoint problem. Suppose we have a tightly stretched 
quickly spinning elastic string or rope of uniform linear density p. Let us put this problem into the 
xy-plane. The x axis represents the position on the string. The string rotates at angular velocity to, 
so we will assume that the whole xy-plane rotates at angular velocity co. We will assume that the 
string stays in this xy-plane and y will measure its deflection from the equilibrium position, y = 0, 
on the X axis. Hence, we will find a graph giving the shape of the string. We will ideahze the string 
to have no volume to just be a mathematical curve. If we take a small segment and we look at the 
tension at the endpoints, we see that this force is tangential and we will assume that the magnitude 
is the same at both end points. Hence the magnitude is constant everywhere and we will call its 
magnitude T. If we assume that the deflection is small, then we can use Newton's second law to get 
an equation 

Ty" + po/y = 0. 

Let L be the length of the string and the string is fixed at the beginning and end points. Hence, 
y(0) = and yiL) = 0. See Figure 4.1. 




Figure 4.1: Whirling string. 



We rewrite the equation as y" + ^y = 0. The setup is similar to Example 4.1.3 on page 150, 
except for the interval length being L instead of n. We are looking for eigenvalues of y" + Ay = 

2 

0,y(0) = 0,y(L) = where A = As before there are no nonpositive eigenvalues. With A > 0, the 
general solution to the equation isy = A cos(V^x) + B sin(V^x). The condition y(0) = implies 
that A = as before. The condition y(L) = implies that sin(V^L) = and hence V^L = kn for 
some integer k > 0, so 

pa>^ k^n'^ 

T = ^ = ~L?- 

What does this say about the shape of the string? It says that for all parameters p, a*, T not 
satisfying the above equation, the string is in the equilibrium position, y = 0. When ^ = 
then the string will "pop out" some distance B at the midpoint. We cannot compute B with the 
information we have. 

Let us assume that p and T are fixed and we are changing oj. For most values of oj the string is 
in the equilibrium state. When the angular velocity oj hits a value oo = then the string will pop 
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out and will have the shape of a sin wave crossing the x axis k times. When co changes again, the 
string returns to the equilibrium position. You can see that the higher the angular velocity the more 
times it crosses the x axis when it is popped out. 

4.1.6 Exercises 

Hint for the following exercises: Note that when A> 0, then cos(^fA{t - a)) and sm(^/A(t - a)) are 
also solutions of the homogeneous equation. 

Exercise 4.1.2; Compute all eigenvalues and eigenfunctions of x" + /Lt = 0, x{a) = 0, xi})) - 
{assume a < b). 

Exercise 4.1.3; Compute all eigenvalues and eigenfunctions of x!' + Ax = 0, x!{a) = 0, x'(b) = 
(assume a < b). 

Exercise 4.1.4; Compute all eigenvalues and eigenfunctions of x!' + /Ix = 0, x!{a) = 0, x(b) = 
(assume a < b). 

Exercise 4.1.5; Compute all eigenvalues and eigenfunctions of x" + /Ix = 0, x(fl) = x(&), x'(a) = 
x'(&) (assume a < b). 

Exercise 4.1.6; We have skipped the case of A < for the boundary value problem x" + Ax = 
0, xi-ii) = x(7f), x'(-7f) = x'in). Finish the calculation and show that there are no negative 
eigenvalues. 

Exercise 4.1.101; Consider a spinning string of length 2 and linear density 0.1 and tension 3. Find 
smallest angular velocity when the string pops out. 

Exercise 4.1.102; Suppose x" + Ax = and x(0) = 1, x(l) = 1. Find all A for which there is more 
than one solution. Also find the corresponding solutions (only for the eigenvalues). 

Exercise 4.1.103; Suppose x" + x = and x(0) = 0, x'{n) = 1. Find all the solution(s) if any exist. 

Exercise 4.1.104; Consider x' + Ax = and x(0) = 0, x(l) = 0. Why does it not have any 
eigenvalues? Why does any first order equation with two endpoint conditions such as above have 
no eigenvalues? 

Exercise 4.1.105 (challenging); Suppose x"' + Ax = and x(0) = 0, x'(O) = 0, x(l) = 0. Suppose 
that A > 0. Find an equation that all such eigenvalues must satisfy. Hint: Note that - ^[A is a root of 
+ A = 0. 
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4.2 The trigonometric series 



Note: 2 lectures, §9.1 in [EPJ, §10.2 in [BDJ 



4.2.1 Periodic functions and motivation 



As motivation for studying Fourier series, suppose we have the problem 



x" + colx = fit). 



(4.6) 



for some periodic function f{t). We have already solved 



x" + oj\x = pQCOsiajt). 



(4.7) 



One way to solve (4.6) is to decompose f(t) as a sum of cosines (and sines) and then solve many 
problems of the form (4.7) . We then use the principle of superposition, to sum up all the solutions 
we got to get a solution to (4.6) . 

Before we proceed, let us talk a little bit more in detail about periodic functions. A function 
is said to be periodic with period P if f{t) = fit + P) for all t. For brevity we will say fit) is 
P-periodic. Note that a P-periodic function is also 2/'-periodic, SP-periodic and so on. For example, 
cos(0 and sin(0 are 2;r-periodic. So are cos(^0 and sin(/:0 for all integers k. The constant functions 
are an extreme example. They are periodic for any period (exercise). 

Normally we will start with a function fit) defined on some interval [-L, L] and we will want 
to extend periodically to make it a 2L-periodic function. We do this extension by defining a new 
function Fit) such that for t in [-L, L], Fit) = fit). For t in [L, 3L], we define Fit) = fit - 2L), for 
t in [-3L, -L], Fit) = fit + 2L), and so on. We assumed that fi-L) = fiL). We could have also 
started with / defined only on the half-open interval (-L, L] and then define fi-L) = fiL). 

Example 4.2.1: Define fit) = I - t^ on [-1, 1]. Now extend periodically to a 2-periodic function. 
See Figure 4.2 on the following page. 

You should be careful to distinguish between fit) and its extension. A common mistake is to 
assume that a formula for fit) holds for its extension. It can be confusing when the formula for fit) 
is periodic, but with perhaps a different period. 

Exercise 4.2.1; Define fit) = cos t on [-^2, Vz]- Take the n-periodic extension and sketch its graph. 
How does it compare to the graph of cos. t? 

4.2.2 Inner product and eigenvector decomposition 

Suppose we have a symmetric matrix, that is = A. We have said before that the eigenvectors of 
A are then orthogonal. Here the word orthogonal means that if v and w are two distinct (and not 
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multiples of each other) eigenvectors of A, then (v, vv) = 0. In this case the inner product (v, w) is 
the dot product, which can be computed as v^w. 

To decompose a vector v in terms of mutually orthogonal vectors wi and W2 we write 

V = aivvi + a2W2. 

Let us find the formula for ai and a2. First let us compute 

<v,vvi) = (aivvi + a2W2,Wi) = ai<vvi,vvi) + a2<vv2,vvi) = ai{wi,Wi). 

Therefore, 



Similarly 



ai = 



a2 



<V, W2) 



{W2,W2) 

You probably remember this formula from vector calculus. 

Example 4.2.2: Write v = [ ^ ] as a linear combination of vvi = [ _\ ] and VV2 = [ } ]• 
First note that wi and W2 are orthogonal as (vvi, VV2) = 1(1) + (-1)1 = 0. Then 

_ 2(l) + 3(-l) _-l 
2 ' 



ai = 
a2 = 



<0i,w?i) 1(1) + (-!)(-!) 
{v,W2) ^ 2 + 3 ^ 5 
2' 



{W2,W2) 



1 + 1 



Hence 



2 


-1 


1 


5 

+ - 
2 


1 


3 


~ T 


-1 


1 
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4.2.3 The trigonometric series 



Instead of decomposing a vector in terms of eigenvectors of a matrix, we will decompose a function 
in terms of eigenfunctions of a certain eigenvalue problem. The eigenvalue problem we will use for 
the Fourier series is 

x" + Ax = 0, x(-n) = x(n), x'(-7t) = x'(7t). 

We have previously computed that the eigenfunctions are 1, cos{kt), sin(^0- That is, we will want to 
find a representation of a 2;r-periodic function f{t) as 



f{t) = ^ + ^ <5[fi cos(nt) + bn sm{nt). 



n=\ 



This series is called the Fourier series* or the trigonometric series for f{t). We write the coefficient 
of the eigenf unction 1 as y for convenience. We could also think of 1 = cos(00, so that we only 
need to look at cos{kt) and sin{kt). 

As for matrices we want to find a projection of f{t) onto the subspace generated by the 
eigenfunctions. So we will want to define an inner product of functions. For example, to find a„ we 
want to compute ( f{t) , cos(nO ). We define the inner product as 



{f{t),g{t)) 



def I 
•J-n 



f{t)g(t) dt. 



With this definition of the inner product, we have seen in the previous section that the eigenfunctions 
cos{kt) (including the constant eigenf unction), and sm{kt) are orthogonal in the sense that 



( cos(mf) , cos(nt) ) = 
( sin(mf) , sin(nf) ) = 
( sin(mf) , cos(nf) ) = 



for m n, 
for m n, 
for all m and n. 



By elementary calculus for n = 1, 2, 3, ... we have ( cos(nO , co%{nt) ) = n and ( sin(nO , sin(nO ) 
n. For the constant we get that ( 1 , 1 ) = In. The coefficients are given by 



a„ = 



bn 



</(o,cos(no) 1 r%,, , , . 

—77 = - fit) cos(nt) dt, 
nt) ) n 

1 r 

fit) sm(nt) dt. 



{ cos(nt) , cos( 
(fit), sin(/iO) 



( sm{nt) , sin{nt) ) 

Compare these expressions with the finite-dimensional example. For gq we get a similar formula 



ao 



' (1,1) 



1 r 

^ J-n 



fit) dt. 



*Named after the French mathematician Jean Baptiste Joseph Fourier (1768 - 1830). 
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Let us check the formulas using the orthogonality properties. Suppose for a moment that 



f(t) = — + 2^an cos{nt) + bn sin(nO- 



«=i 



Then for m > 1 we have 



( f{t) , cos(mO ) = ( ^ + ^ cos(nO + bn sin(nO , cos(mO ^ 



H = l 



-< 1 , cos(mO > + 2, cosint) , cos(mt) ) + b„{ sin(nO , cos(mO ) 



n=i 

= ami cos{mt) , cos(mt) ). 
And hence a„, = '^-^^p'^"^'-'"'''] 

{ cos{mt) , cos(mf) ) 

Exercise 4.2.2: Carry out the calculation for ao and bm- 
Example 4.2.3: Take the function 

fit) = t 

for t in i-n, n]. Extend fit) periodically and write it as a Fourier series. This function is called the 
sawtooth. 




-5.0 -2.5 



2.5 5.0 



Figure 4.3: The graph of the sawtooth function. 



The plot of the extended periodic function is given in Figure 4.3. Let us compute the coefficients. 
We start with ao, 

1 r 

ao = - I t dt = 0. 
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We will often use the result from calculus that says that the integral of an odd function over a 
symmetric interval is zero. Recall that an odd function is a function (p{t) such that (p{-t) = -(p{t). 
For example the functions t, sin t, or (importantly for us) tcos(nt) are all odd functions. Thus 



1 r 

2„ = - I tcos{n 



t) dt = 0. 



Let us move to b„. Another useful fact from calculus is that the integral of an even function over a 
symmetric interval is twice the integral of the same function over half the interval. Recall an even 
function is a function (p{t) such that ip{-t) = (p(t). For example t sm{nt) is even. 



1 r 

?n = - I tsm{n 

^ J-n 

2 r 

= — I ?sm(n 
^ Jo 



t) dt 
tcos{nt) 



2 
n 

2 ( -ncosinn) 
n 



1 r 

+ - cos{nt) dt 
t=o " Jo 



+ 



-2cos(n7T) 2(-l) 



We have used the fact that 



The series, therefore, is 



cos(nn) = (-1)" = 



y 2(-l) 
^ n 

n=l 



n+1 



1 1 if n even, 
I - 1 if n odd. 

sin(nO- 



Let us write out the first 3 harmonics of the series for f{t). 



2 sin(0 - sin(20 + - sin(30 + ■ ■ • 

The plot of these first three terms of the series, along with a plot of the first 20 terms is given in 
Figure 4.4 on the following page. 

Example 4.2.4: Take the function 



fit) 



[0 if -n<t< 0, 
\n if <t <n. 
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-5.0 -2.5 0.0 2.5 5.0 -5.0 -2.5 0.0 2.5 5.0 



Figure 4.4: First 3 (left graph) and 20 (right graph) harmonics of the sawtooth function. 



-2.5 0.0 2.5 5.0 



Figure 4.5: The graph of the square wave function. 



Extend f(t) periodically and write it as a Fourier series. This function or its variants appear often in 
applications and the function is called the square wave. 

The plot of the extended periodic function is given in Figure 4.5. Now we compute the 
coefficients. Let us start with ao 

I r I r 

ao = - I f(t) dt = - I n dt = n. 

^ J-;r ^ Jo 

Next, 

an = - \ f(t)cos(nt) dt = - I 7TCOs(nt) dt = 0. 

^ J-n ^ Jo 
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And finally 





1 


l-'TT 








fit) sm{nt) at 


n 








1 


r ■ 


(nt) dt 








n 


Jo 






cos(nt) 


7T 






n 


t=0 




1 


- cos{nn) 1 - (- 






n 


n 



if n is odd, 



= r 

if n is even. 



The Fourier series is 



2 



J] - sinint) = l + Y, ^in((2^ - 1) 0- 

n=l k=l 
n odd 

Let us write out the first 3 harmonics of the series for f{t). 



n 2 

- + 2 sin(0 + - sin(30 + ■ • • 

The plot of these first three and also of the first 20 terms of the series is given in Figure 4.6. 
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Figure 4.6: First 3 (left graph) and 20 (right graph) harmonics of the square wave function. 



We have so far skirted the issue of convergence. For example, if f(t) is the square wave function, 
the equation 

7T °° 2 



k=l 
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is only an equality for such t where f(t) is continuous. That is, we do not get an equality for 
t = -7T, 0, n and all the other discontinuities of f(t). It is not hard to see that when t is an integer 
multiple of n (which includes all the discontinuities), then 



n 



+ 



We redefine f{t) on [-n, n] as 



k=i 



2k -\ 



sm{(2k- 1)0 



n 
2' 



m 



ii -n < t < 0, 
n if <t <n, 
"ji if t = -n, t = 0, or t = n, 



and extend periodically. The series equals this extended f{t) everywhere, including the disconti- 
nuities. We will generally not worry about changing the function values at several (finitely many) 
points. 

We will say more about convergence in the next section. Let us however mention briefly an 
effect of the discontinuity. Let us zoom in near the discontinuity in the square wave. Further, let 
us plot the first 100 harmonics, see Figure 4.7. You will notice that while the series is a very good 
approximation away from the discontinuities, the error (the overshoot) near the discontinuity at 
t = n does not seem to be getting any smaller. This behavior is known as the Gibbs phenomenon. 
The region where the error is large does get smaller, however, the more terms in the series we take. 



1.75 2.00 2.25 2.50 2.75 3.00 3.25 



Figure 4.7: Gibbs phenomenon in action. 



We can think of a periodic function as a "signal" being a superposition of many signals of pure 
frequency. For example, we could think of the square wave as a tone of certain base frequency. 
It will be, in fact, a superposition of many different pure tones of frequencies that are multiples 
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of the base frequency. On the other hand a simple sine wave is only the pure tone. The simplest 
way to make sound using a computer is the square wave, and the sound is very different from nice 
pure tones. If you have played video games from the 1980s or so, then you have heard what square 
waves sound like. 



4.2.4 Exercises 

Exercise 4.2.3; Suppose f(t) is defined on [-n,n] as sin(50 + cos(30. Extend periodically and 
compute the Fourier series of f{t). 

Exercise 4.2.4; Suppose f(t) is defined on [-n, n] as \t\. Extend periodically and compute the 
Fourier series of f{t). 

Exercise 4.2.5; Suppose f(t) is defined on [-n, n] as \t\^. Extend periodically and compute the 
Fourier series of f{t). 



f(t) = 



Exercise 4.2.6; Suppose f(t) is defined on (-n, n] as 

^-1 if-n<t<0, 
\ if 0<t<n. 

Extend periodically and compute the Fourier series of f{t). 

Exercise 4.2.7; Suppose f(t) is defined on (-n, tt] as t^. Extend periodically and compute the 
Fourier series of f{t). 

Exercise 4.2.8; Suppose f(t) is defined on [-n, tt] as t^. Extend periodically and compute the 
Fourier series of f{t). 

There is another form of the Fourier series using complex exponentials that is sometimes easier 
to work with. 

Exercise 4.2.9; Let 

oo 

ao v~i 

f(t) = IT + / cin cos(nt) + bn sm(nt). 

^ n=l 

Use Euler's formula e'^ = cos(9) + i sm(6) to show that there exist complex numbers c^ such that 

CO 



Note that the sum now ranges over all the integers including negative ones. Do not worry about 
convergence in this calculation. Hint: It may be better to start from the complex exponential form 
and write the series as 



C0 + J^c^e''"' + c_,e-''"' 

m=l 
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Exercise 4.2.101; Suppose fit) is defined on \-n, 7i\ as f{t) = sm(t). Extend periodically and 
compute the Fourier series. 

Exercise 4.2.102; Suppose fit) is defined on (-n, n] as f(t) = sin(7rO. Extend periodically and 
compute the Fourier series. 

Exercise 4.2.103; Suppose fit) is defined on i-n, tt] as fit) = sin^(0. Extend periodically and 
compute the Fourier series. 

Exercise 4.2.104; Suppose fit) is defined on i-n, n] as fit) = t^. Extend periodically and compute 
the Fourier series. 
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4.3 More on the Fourier series 

Note: 2 lectures, §9.2 - §9.3 in [BP], §10.3 in [BD] 

Before reading the lecture, it may be good to first try Project IV (Fourier series) from the 
lODE website: http : //www . math . uiuc . edu/iode/. After reading the lecture it may be good to 
continue with Project V (Fourier series again). 



4.3.1 2L-periodic functions 

We have computed the Fourier series for a 2;;r-periodic function, but what about functions of different 
periods. Well, fear not, the computation is a simple case of change of variables. We can just rescale 
the independent axis. Suppose that we have a 2L-periodic function f(t) (L is called the half period). 
Let s = ft. Then the function 

is 2;r-periodic. We want to also rescale all our sines and cosines. We want to write 



CO 

^ a„ cos ?j + b„ sin ?j . 

n=l 



If we change variables to s we see that 



ClQ V~l 

g(s) = IT + / <^n covins) + bn ^m{ns). 



n=l 



We compute a„ and bn as before. After we write down the integrals we change variables from s 
back to t. 



ao 



- [ g(s) ds = ]r [ fit) dt. 



1 r 1 r 

2n = - g(s) cos{ns) ds = - I 

I r I r 

= - gis) sm(ns) ds = - \ 



fit) cos(^^t] dt, 

^ /nn 

fit) sin — ? ) dt. 
-L ^ L 



The two most common half periods that show up in examples are n and 1 because of the 
simplicity. We should stress that we have done no new mathematics, we have only changed 
variables. If you understand the Fourier series for 27r-periodic functions, you understand it for 2L- 
periodic functions. All that we are doing is moving some constants around, but all the mathematics 
is the same. 
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Example 4.3.1: Let 

f(t) = \t\ for-l<?<l, 

extended periodically. The plot of the periodic extension is given in Figure 4.8. Compute the Fourier 
series of f{t). 




-2-1012 



Figure 4.8: Periodic extension of the function f(t). 



We want to write f(t) = y + 2^=1 cos(nnt) + bn sm(nnt). For n > 1 we note that \t\ cos(nnt) 
is even and hence 



f(t) cos(nnt) dt 
1 



= 2 I t cos(nnt) dt 
= 2 



t y TM 

— sm(nnt) - 2 — s'm(nnt) dt 
in \t=o Jo nn 

^ 1 r . ^l^ 2((-l)"-l) fo if n is even, 

+ cos(n7rf) = — = < , 

^2^/ L h=o n^Ti^ if n IS odd. 



Next we find 



dt = 1. 



You should be able to find this integral by thinking about the integral as the area under the graph 
without doing any computation at all. Finally we can find bn- Here, we notice that \t\ sm{nnt) is odd 
and, therefore. 



= I, 



fit) sininnt) dt = 0. 
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Hence, the series is 

1 -4 

- + > -iri cos(nnt). 

2 ^ n^n^ 

n=\ 
n odd 

Let us explicitly write down the first few terms of the series up to the 3'^'^ harmonic. 

1 4 4 

- - — cos(7r0 - — cos(37rO 

2 97r-^ 

The plot of these few terms and also a plot up to the 20"^ harmonic is given in Figure 4.9. You 
should notice how close the graph is to the real function. You should also notice that there is no 
"Gibbs phenomenon" present as there are no discontinuities. 




-2-1 1 2-2-1 1 



Figure 4.9: Fourier series of fit) up to the 3 harmonic (left graph) and up to the 20 harmonic 
(right graph). 



4.3.2 Convergence 

We will need the one sided limits of functions. We will use the following notation 

/(C-) = lim/(0, and /(c+) = lim/(0. 

fTc tic 

If you are unfamiliar with this notation, \vcAt\c /(O means we are taking a limit of f{f) as t approaches 
c from below (i.e. t < c) and lim^c f(t) means we are taking a limit of f(t) as t approaches c from 
above (i.e. t > c). For example, for the square wave function 

/« = |° (4.8) 

TT if 0<t<n, 
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we have /(0-) = and /(0+) = n. 

Let f(t) be a function defined on an interval [a, b]. Suppose that we find finitely many points 
a = to, ti, t2, . . . , tk = b in the interval, such that f(t) is continuous on the intervals (to, ti), {t\,t2), 
(ti,.i,tk). Also suppose that all the one sided limits exist, that is, all of fito+), f(ti-), f(ti+), 
fih-), f(h+), fih-) exist and are finite. Then we say f{t) is piecewise continuous. 

If moreover, f{t) is differentiable at all but finitely many points, and f'{t) is piecewise continuous, 
then f{t) is said to be piecewise smooth. 

Example 4.3.2: The square wave function (4.8) is piecewise smooth on {-n, Tf\ or any other interval. 
In such a case we simply say that the function is piecewise smooth. 

Example 4.3.3: The function f{t) = \t\ is piecewise smooth. 

Example 4.3.4: The function fit) = 7 is not piecewise smooth on [-1, 1] (or any other interval 
containing zero). In fact, it is not even piecewise continuous. 

Example 4.3.5: The function f{t) = yftis, not piecewise smooth on [-1, 1] (or any other interval 
containing zero). f{t) is continuous, but the derivative of f{t) is unbounded near zero and hence not 
piecewise continuous. 

Piecewise smooth functions have an easy answer on the convergence of the Fourier series. 
Theorem 4.3.1. Suppose fit) is a 2L-periodic piecewise smooth function. Let 

1^ + 2^an cos I ^ n + sm ( — 1 1 

n=l 

be the Fourier series for fit). Then the series converges for all t. If fit) is continuous near t, then 

00 

ao Inn \ . Inn \ 

fit) = y + 2^ a„ cos y— ?j + bn sm y— tj . 

H=l 

Otherwise 

fit-) + fit+) ao , V /"^ .\ , J, ■ /"^ .\ 
= - + ^a„cos[-tj + b^sm[-ty 

n=l 

If we happen to have that fit) = ^'^'^^Y'^''*'^ at all the discontinuities, the Fourier series converges 
to fit) everywhere. We can always just redefine fit) by changing the value at each discontinuity 
appropriately. Then we can write an equals sign between fit) and the series without any worry. We 
mentioned this fact briefly at the end last section. 

Note that the theorem does not say how fast the series converges. Think back to the discussion 
of the Gibbs phenomenon in the last section. The closer you get to the discontinuity, the more terms 
you need to take to get an accurate approximation to the function. 
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4.3.3 Differentiation and integration of Fourier series 

Not only does Fourier series converge nicely, but it is easy to differentiate and integrate the series. 
We can do this just by differentiating or integrating term by term. 

Theorem 4.3.2. Suppose 



CO 

fit) = — + 2^a„ cosl — t\ + bn sm ( — 1 1 



is a piecewise smooth continuous function and the derivative f'(t) is piecewise smooth. Then the 
derivative can be obtained by differentiating term by term, 

annn . (nn \ bnnn (nn 



-annn . (nn \ bnnn (nn \ 

n=\ 



It is important that the function is continuous. It can have corners, but no jumps. Otherwise the 
differentiated series will fail to converge. For an exercise, take the series obtained for the square 
wave and try to differentiate the series. Similarly, we can also integrate a Fourier series. 

Theorem 4.3.3. Suppose 



CO 

ao (nn \ , . (nn 

fit) = — + 2^a„cosl — t\ + bn sm ( — t 

n=\ 



is a piecewise smooth function. Then the antiderivative is obtained by antidijferentiating term by 
term and so 

F(0 = ^+C + y — sm — r + cos — ? , 
2 ^ nn \ L I nn \ L I 

n=l 

where F'(t) = f(t) and C is an arbitrary constant. 

Note that the series for F{t) is no longer a Fourier series as it contains the ^ term. The 
antiderivative of a periodic function need no longer be periodic and so we should not expect a 
Fourier series. 



4.3.4 Rates of convergence and smoothness 

Let us do an example of a periodic function with one derivative everywhere. 
Example 4.3.6: Take the function 

\(t+ l)t if -1 < r < 0, 



\il-t)t if 0<t<l, 



and extend to a 2-periodic function. The plot is given in Figure 4.10 on the following page. 

Note that this function has one derivative everywhere, but it does not have a second derivative 
whenever ns an integer. 
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Exercise 4.3.1; Compute /"(0+) and f"(0-). 

Let us compute the Fourier series coefficients. The actual computation involves several integra- 
tion by parts and is left to student. 

f(t)dt= I {t+l)tdt+ I (l-t)tdt = 0, 
1 J-i Jo 

f(t) cos{nnt) dt = I {t + l)t cos(nnt) dt + I {1 - t)t cos(nnt) dt = 
1 J-i Jo 

XI ^0 ^1 

f(t) sm(nnt) dt = I (t + l)t sm(nnt) dt + I (1 - t)t sm(nnt) dt 
1 J-i Jo 



4(1_(_1)«) _ J_8_ if „ is odd, 



n^n^ 1 if n is even. 

That is, the series is 



^ 8 

> — - sm(n;rO. 



n=\ 
n odd 



This series converges very fast. If you plot up to the third harmonic, that is the function 

8 8 
— sin(7r0 + — sin(3;r0, 

it is almost indistinguishable from the plot of fit) in Figure 4.10. In fact, the coefficient is 
already just 0.0096 (approximately). The reason for this behavior is the term in the denominator. 
The coefficients bn in this case go to zero as fast as goes to zero. 
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For functions constructed piecewise from polynomials as above, it is generally true that if you 
have one derivative, the Fourier coefficients will go to zero approximately like V«^- If you have only 
a continuous function, then the Fourier coefficients will go to zero as V"^- If you have discontinuities, 
then the Fourier coefficients will go to zero approximately as V«- For more general functions the 
story is somewhat more complicated but the same idea holds, the more derivatives you have, the 
faster the coefficients go to zero. Similar reasoning works in reverse. If the coefficients go to 
zero like '/"^ you always obtain a continuous function. If they go to zero like you obtain an 
everywhere differentiable function. 

To justify this behavior, take for example the function defined by the Fourier series 



n=l 

When we differentiate term by term we notice 



CO ^ 

fit) = y ^ sin(nO. 



CO ^ 

fit) = V ^ cos(nO. 

n=i 



Therefore, the coefficients now go down like which means that we have a continuous function. 
The derivative of fit) is defined at most points, but there are points where fit) is not diff'erentiable. 
It has comers, but no jumps. If we differentiate again (where we can) we find that the function fit), 
now fails to be continuous (has jumps) 



/"(0=y — sin(nO. 
^ n 

n=i 

This function is similar to the sawtooth. If we tried to differentiate the series again we would obtain 

oo 

^ - cosint), 

n=l 

which does not converge! 

Exercise 4.3.2; Use a computer to plot the series we obtained far ft), fit) and fit). That is, plot 
say the first 5 harmonics of the functions. At what points does fit) have the discontinuities? 

4.3.5 Exercises 
Exercise 4.3.3; Let 

fit) = 



[0 if-l<t<0, 
\t if Q<t<l, 



extended periodically, a) Compute the Fourier series for fit), b) Write out the series explicitly up to 
the harmonic. 
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Exercise 4.3.4; Let 

if-\<t<0. 



m = 



f if 0<t<\, 



extended periodically, a) Compute the Fourier series for f{t). b) Write out the series explicitly up to 
the 3'"'^ harmonic. 

Exercise 4.3.5; Let 

f(,. = {-o if-^0<t<0, 
if 0<t<10, 

extended periodically (period is 20). a) Compute the Fourier series for fit), b) Write out the series 
explicitly up to the 3''^ harmonic. 

Exercise 4.3.6; Let f(t) = ^ cos(nt). Is f(t) continuous and differentiable everywhere? Find 
the derivative (if it exists everywhere) or justify why fit) is not differentiable everywhere. 

Exercise 4.3.7; Let fit) = Z^i ~~ sin(nO- J^s fit) differentiable everywhere? Find the derivative 
( if it exists everywhere) or justify why fit) is not differentiable everywhere. 

Exercise 4.3.8; Let 

if -2<t< 0, 

t if <t<l, 

-t + 2 if I <t<2. 



fit) 



extended periodically, a) Compute the Fourier series for fit), b) Write out the series explicitly up to 
the harmonic. 

Exercise 4.3.9; Let 

fit)^e' for-l<t<\ 

extended periodically, a) Compute the Fourier series for fit), b) Write out the series explicitly up to 
the harmonic, c) What does the series converge to at t = 1. 

Exercise 4.3.10; Let 

fit)^t^ for-\<t<\ 

extended periodically, a) Compute the Fourier series for fit), b) By plugging in t = 0, evaluate 

^ i-\f 11 ^ \ \ \ 

y — T— = l- T + :;^-'""-c) Now evaluate > = 1 + - + . 

n=\ n=l 



Exercise 4.3.101; Let 



fit) = t^ for-2<t<2 



extended periodically, a) Compute the Fourier series for fit), b) Write out the series explicitly up to 
the 3rd harmonic. 
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Exercise 4.3.102; Let 

f(t) = t for A < t < A (for some A) 

extended periodically, a) Compute the Fourier series for f(t). b) Write out the series explicitly up to 
the 3rd harmonic. 

Exercise 4.3.103; Let 

f^^^ = + Z VTTT^ sin(n;rO. 
2 ^ nin^ + 1) 

n=l 

Compute f'(t). 
Exercise 4.3.104; Let 

/(O = 2 + ~ cos(nO- 
a) Find the antiderivative. b) Is the antiderivative periodic? 
Exercise 4.3.105; Let 

f(t) = t/2 for-n <t <n 

extended periodically, a) Compute the Fourier series for f(t). b) Plug in t = ^2 to find a series 
representation for V4. c) Using the first 4 terms of the result from part b) approximate V4. 
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4.4 Sine and cosine series 

Note: 2 lectures, §9.3 in [EPJ, §10.4 in [BP] 

4.4.1 Odd and even periodic functions 

You may have noticed by now that an odd function has no cosine terms in the Fourier series and an 
even function has no sine terms in the Fourier series. This observation is not a coincidence. Let us 
look at even and odd periodic function in more detail. 

Recall that a function f{t) is odd if f{-t) = -f{t). A function f{t) is even if f{-t) = f{t). For 
example, cos(nt) is even and sm(nt) is odd. Similarly the function t'' is even if k is even and odd 
when k is odd. 

Exercise 4.4.1; Take two functions f(t) and g{t) and define their product h{t) = f{t)g{t). a) Suppose 
both are odd, is h(t) odd or even? b) Suppose one is even and one is odd, is h{t) odd or even? c) 
Suppose both are even, is h{t) odd or even ? 

If fit) and g{t) are both odd, then f{t) + g{t) is odd. Similarly for even functions. On the other 
hand, if f{t) is odd and g{t) even, then we cannot say anything about the sum f{t) + g{t). In fact, the 
Fourier series of any function is a sum of an odd (the sine terms) and an even (the cosine terms) 
function. 

In this section we consider odd and even periodic functions. We have previously defined the 2L- 
periodic extension of a function defined on the interval [-L, L]. Sometimes we are only interested 
in the function on the range [0, L] and it would be convenient to have an odd (resp. even) function. 
If the function is odd (resp. even), all the cosine (resp. sine) terms will disappear. What we will do 
is take the odd (resp. even) extension of the function to [-L, L] and then extend periodically to a 
2L-periodic function. 

Take a function f{t) defined on [0, L] . On (-L, L] define the functions 



Extend Fodd(0 and Feven(0 to be 2L-periodic. Then Fodd(0 is called the odd periodic extension of 
f{t), and i^even(0 is called the even periodic extension of f{t). 

Exercise 4.4.2; Check that Foddit) is odd and that Feven{t) is even. 

Example 4.4.1: Take the function f{t) = t{l - t) defined on [0, 1]. Figure 4.1 1 on the facing page 
shows the plots of the odd and even extensions of f{t). 
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Figure 4.11: Odd and even 2-periodic extension of f{t) = t{l - t),0 < t < I. 



4.4.2 Sine and cosine series 

Let f{t) be an odd 2L-periodic function. We write the Fourier series for f{t). First, we compute the 
coefficients a„ (including n = 0) and get 



1 (nn \ 

= J fit) COS y— fj dt = 0. 



That is, there are no cosine terms in the Fourier series of an odd function. The integral is zero 
because f(t) cos (nnL f) is an odd function (product of an odd and an even function is odd) and 
the integral of an odd function over a symmetric interval is always zero. The integral of an even 
function over a symmetric interval [-L, L] is twice the integral of the function over the interval 
[0, L]. The function f{t) sin is the product of two odd functions and hence is even. 

1 Inn \ 2 Inn \ 

= - J ^ fit) sin y— tj dt=- fit) sin ^— tj dt. 

We now write the Fourier series of fit) as 



oo 

sin^^rj, 

n=l 



Similarly, if f(t) is an even 2L-periodic function. For the same exact reasons as above, we find 
that bn = and 



2 r (nn \ 

«n = - J /(Ocos(^— ?j dt. 
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The formula still works for n = 0, in which case it becomes 



2 



fit) dt. 



The Fourier series is then 



Oq 

2 



+ 



oo 
n=l 



An interesting consequence is that the coefficients of the Fourier series of an odd (or even) 
function can be computed by just integrating over the half interval [0, L]. Therefore, we can compute 
the Fourier series of the odd (or even) extension of a function by computing certain integrals over 
the interval where the original function is defined. 

Theorem 4.4.1. Let f{t) be a piecewise smooth function defined on [0,L]. Then the odd extension 
of f{t) has the Fourier series 



where 



oo 

Foddit) = ^bn sin 


(nn \ 

It')- 









The even extension of f{t) has the Fourier series 



CO 

Fevenit) = y + COS ^— H , 

n=l 



where 



2 (nn \ , 

«n = J fit) COS ?j dt. 



The series sin {^t^is called the sine series of fit) and the series y + cos ( ^ ^) 

is called the cosine series of fit). We often do not actually care what happens outside of [0,L]. In 
this case, we pick whichever series fits our problem better. 

It is not necessary to start with the full Fourier series to obtain the sine and cosine series. The 
sine series is really the eigenfunction expansion of fit) using the eigenfunctions of the eigenvalue 
problem xf' + Ax = 0, x(0) = 0, x(L) = L. The cosine series is the eigenfunction expansion of fit) 
using the eigenfunctions of the eigenvalue problem x" + Ax = 0, x'iO) = 0, xfiL) = L. We could 
have, therefore, gotten the same formulas by defining the inner product 



{fit), git)) 



Jo 



fit)git) dt. 
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and following the procedure of § 4.2. This point of view is useful, as we commonly use a specific 
series that arose because our underlying question led to a certain eigenvalue problem. If the 
eigenvalue problem is not one of the three we covered so far, you can still do an eigenfunction 
expansion, generalizing the results of this chapter. We will deal with such a generalization in 
chapter 5. 

Example 4.4.2: Find the Fourier series of the even periodic extension of the function f{t) = f for 
0<t<n. 

We want to write 

CO 



fit) = — + 2^ a„ cos(nO, 



;i=l 



where 



and 



2 r 

^ Jo 



ao = - I t dt= —., 



2 r" 2 r 1 i'^ 4 r"^ 

cin = - \ f' cos{nt) dt = - t^-sm(nt) ( tsm{nt)dt 

ttJo n[ n J,, nn Jo 

4 r 4 r 4(-l)" 
= —-\tcos(nt)\ + —r- cos{nt) dt = — . 

Note that we have "detected" the continuity of the extension since the coefficients decay as ^. That 
is, the even extension of f- has no jump discontinuities. It does have corners, since the derivative, 
which is an odd function and a sine series, has jumps; it has a Fourier series whose coefficients 
decay only as ^ . 

Explicitly, the first few terms of the series are 

7^ 4 

y - 4 cos(0 + cos(20 - - cos(30 + ■ • • 

Exercise 4.4.3; a) Compute the derivative of the even extension of f{t) above and verify it has jump 
discontinuities. Use the actual definition off(t), not its cosine series! b) Why is it that the derivative 
of the even extension of f{t) is the odd extension of f'{t)? 



4.4.3 Application 

Fourier series ties in to the boundary value problems we studied earlier. Let us see this connection 
in more detail. 

Suppose we have the boundary value problem for < ? < L, 



x"{t) + Ax{t) = f{t). 
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for the Dirichlet boundary conditions x{0) = 0, x{L) = 0. By using the Fredholm alternative 
(Theorem 4.1.2 on page 154) we note that as long as A is not an eigenvalue of the underlying 
homogeneous problem, there exists a unique solution. Note that the eigenfunctions of this eigenvalue 
problem are the functions sin^^^j. Therefore, to find the solution, we first find the Fourier sine 
series for f{t). We write x also as a sine series, but with unknown coefficients. We substitute the 
series for x into the equation and solve for the unknown coefficients. If we have the Neumann 
boundary conditions x'{0) = 0, x'(L) = 0, we do the same procedure using the cosine series. 
Let us see how this method works on examples. 

Example 4.4.3: Take the boundary value problem for < t < 1, 

x"(t) + 2x(t) = f(tX 

where f(t) = t onO < t < 1, and satisfying the Dirichlet boundary conditions x(0) = 0, .x;(l) = 0. 
We write f{t) as a sine series 

oo 

fit) = 2 c„ sininnt), 

2(-l)"+^ 



n=l 



where 



Jo 



t sm{nnt) dt = 



nn 



We write x{t) as 



We plug in to obtain 



x(t) =} bn ?>m{nnt). 



n=l 



x"{t) + 2x{t) = ^ -bnn^n^ sm(nnt) + 2 ^ sm(nnt) 

n=\ n=\ 

oo 

= ^ bn{2 - n^n^) sm(nnt) 

n=\ 

^ 2(-ir+i 

= fit) = ) , sm(nnt). 



n=\ 

Therefore, 



\n+l 

,, ,, / I — I 

bn{2 - n'n') 



.2_2. 2(-ir 



nn 
or 

\n+l 



2(-ir 

bn = 



nn{2 — n^n^) 
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We have thus obtained a Fourier series for the solution 

n+l 



V 2(-l) . , , 

x(t) = 2, — ^ sin(n;rO. 

^ nn (2 - n^n^) 

n=l 

Example 4.4.4: Similarly we handle the Neumann conditions. Take the boundary value problem 
for < r < 1, 

x"{t) + 2x{t) = f{t\ 

where again f{t) = t onQ < t < 1, but now satisfying the Neumann boundary conditions Jc'(O) = 0, 
jc'(l) = 0. We write f{t) as a cosine series 

oo 

fit) = ^ +^c„cos(nnt), 

where 



2 



Co = 2 j t dt = I, 



Jo 



and 



Jo 



. r A^. 2((-ir-l) ^ ifnodd, 

t cosinnt) dt = r— r = " « 

TT n 10 if n even. 

We write x(t) as a cosine series 

CO 

ao 



x(0 = IT + y.^n cos(nnt). 
We plug in to obtain 

oo oo 

x"(t) + 2x(t) = ^^^-a„n^7i^ cos(n7rO] + ao + 2 ^|^a„ cos(n;rO] 

n=l n=l 
oo 

= ao + ^ a„(2 - rP'TT^) cosinnt) 

n=l 

1 -4 

= fit) = o + > , -T^ cosinnt). 

2 ^ n^n^ 

n=i 
n odd 

Therefore, ao = a„ = for n even {n > 2) and for n odd we have 

a„(2 - n^n^) = 
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or 

-4 

The Fourier series for the solution x(t) is 

1 ^ -4 

n=l 
n odd 

4.4.4 Exercises 

Exercise AAA: Take fit) = - 1)^ defined onO < t < 1. a) Sketch the plot of the even periodic 
extension of f. b) Sketch the plot of the odd periodic extension off. 

Exercise 4.4.5; Find the Fourier series of both the odd and even periodic extension of the function 
f(t) = (t - V)^ for < t < 1. Can you tell which extension is continuous from the Fourier series 
coefficients? 

Exercise 4.4.6; Find the Fourier series of both the odd and even periodic extension of the function 
fit) = tfor 0<t<7T. 

Exercise 4.4.7; Find the Fourier series of the even periodic extension of the function fit) = smt 
forO<t<n. 

Exercise 4.4.8; Consider 

x"it) + 4xit) = fit), 

where fit) = I onO < t < 1. a) Solve for the Dirichlet conditions ^(0) = 0,xi\) = 0. b) Solve for 
the Neumann conditions x'(O) = 0, x'(l) = 0. 

Exercise 4.4.9; Consider 

x"it) + 9x{t)^f{t), 

for fit) = sin(2;7rO onO < t < I. a) Solve for the Dirichlet conditions xiO) = 0, xil) = 0. b) Solve 
for the Neumann conditions x'iO) = 0, ^(1) = 0. 

Exercise 4.4.10; Consider 

x"it) + 3x(0 = fit), x(0) = 0, x(l) = 0, 

where fit) = Yi'^=\bn svainnt). Write the solution xit) as a Fourier series, where the coefficients are 
given in terms ofbn- 

Exercise 4.4.11; Let fit) = t^i2 — t)for < t <2. Let Fit) be the odd periodic extension. Compute 
F(l), F(2), F(3), F(-l), F(9/2), F(lOl), F(103). Note: Do not compute using the sine series. 
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Exercise 4.4.101; Let f(t) = '/3 on < t < 3. a) Find the Fourier series of the even periodic 
extension, b) Find the Fourier series of the odd periodic extension. 

Exercise 4.4.102; Let f{t) = cos(20 onO < t < n. a) Find the Fourier series of the even periodic 
extension, b) Find the Fourier series of the odd periodic extension. 

Exercise 4.4.103; Let f(t) be defined onO < t < 1. Now take the average of the two extensions 
= Foddt)+F,,en{t) _ jYf^^f ^(-^) j/O < ? < 1 (Justify!) b) What is g(t) if-l<t<0 (Justify!) 

Exercise 4.4.104; Let f(t) = sm(nt). Solve x" - x = f(t) for the Dirichlet conditions 

x(0) = and x(n) = 0. 

Exercise 4.4.105 (challenging); Let f(t) = t + Y.'^^i ^ sin(nO. Solve x" +nx = f{t) for the Dirichlet 
conditions x(0) = and x(n) = 1. Hint: Note that ^ satisfies the given Dirichlet conditions. 
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4.5 Applications of Fourier series 

Note: 2 lectures, §9.4 in [EPJ, not in [BDJ 

4.5.1 Periodically forced oscillation 



m 



Fit) 
— ► 



Let us return to the forced oscillations. Consider a mass-spring 
system as before, where we have a mass m on a spring with spring 
constant k, with damping c, and a force F(t) applied to the mass. 

Suppose the forcing function F(t) is 2L-periodic for some L > 0. 

damping c ha\e already seen this problem in chapter 2 with a simple F{t). 

The equation that governs this particular setup is 

mx"{t) + cx'it) + kx{t) = F{t). (4.9) 

The general solution consists of the complementary solution Xc, which solves the associated 
homogeneous equation mx" + cx' + = 0, and a particular solution of (4.9) we call Xp. For c > 0, 
the complementary solution Xc will decay as time goes by. Therefore, we are mostly interested in a 
particular solution Xp that does not decay and is periodic with the same period as F{t). We call this 
particular solution the steady periodic solution and we write it as Xsp as before. What will be new in 
this section is that we consider an arbitrary forcing function F{t) instead of a simple cosine. 

For simplicity, let us suppose that c = 0. The problem with c > is very similar. The equation 

mx" +kx = Q 

has the general solution 

x{t) = A cos(a>oO + B sm{<x>ot), 

where loq = -^J^. Any solution to mx"(t) + kx(t) = F(t) is of the form A cos(a»()0 + B sm(a)Qt) + Xsp. 
The steady periodic solution x^p has the same period as F{t). 

la the spirit of the last section and the idea of undetermined coefficients we first write 

DO 

F(t) = — + 2^CnCos\—-t\ + dn sm {-j^ty 

n=l 

Then we write a proposed steady periodic solution x as 

x{t) = y + 2^ a„ cos I — n + b,, sm 1 y ^1 ' 



n=l 



where a„ and bn are unknowns. We plug x into the differential equation and solve for a„ and bn in 
terms of c„ and J„. This process is perhaps best understood by example. 
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Example 4.5.1: Suppose that k = 2, and m = 1. The units are again the mks units (meters- 
kilograms-seconds). There is a jetpack strapped to the mass, which fires with a force of 1 newton 
for 1 second and then is off for 1 second, and so on. We want to find the steady periodic solution. 
The equation is, therefore, 

x" + 2x = F(t), 

where F(t) is the step function 



F(t) 



fO if -1 < ? < 0, 
ll if 0<t<l, 



extended periodically. We write 



F(t) = y + ^ '^n cos(nnt) + dn sm{nnt). 



n=l 



We compute 



Co = 



d„ = 



i: 
x: 

-L 



F{t) cos(nnt) dt 
1 



Jo 



cosinnt) dt = for n > 1, 



F(t) dt = I dt = I, 
Jo 

F(t) sm(nnt) dt 
sin(/i7rO dt 



r - cos(nnt) 
[ nn 

1 -(-!)" ^ 
nn 



t=0 

{- 

) nn 



if n odd, 
if n even. 



So 



We want to try 



x(t) = IT + / .^n cosinnt) + bn sin(n7rO. 



- oo 



n=l 
n odd 



nn 



sm{nnt). 



n=\ 



Once we plug x into the differential equation x" + 2x = F{t), it is clear that a„ = forn > 1 as there 
are no corresponding terms in the series for F(t). Similarly = for n even. Hence we try 



n=l 
n odd 
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n=\ 
n odd 



We plug into the differential equation and obtain 

DO QO 

x" + 2x = ^ ^-bnfP'TT^ sm{nnt)^ + ao + 2 ^ ^bn sm(nnt)^ 

n=l 
n odd 

oo 

= ao + ^ b„{2 - rP'n^) sm{nnt) 

n=\ 
n odd 

1 °° 2 
= F{t) = - + y — sm{nnt). 



2 ^—^ nn 

n=l 
n odd 



So «() = \, b„ = for even n, and for odd n we get 



bn = 



nn(2 — n^n^) 

The steady periodic solution has the Fourier series 

1 ^ 2 
Xspit) = 4 + 2j 



4 ^ nn{2 — rf-n'^) 

n odd 



sin(n;rO. 



We know this is the steady periodic solution as it contains no terms of the complementary solution 
and it is periodic with the same period as F{t) itself. See Figure 4.12 for the plot of this solution. 




Figure 4.12: Plot of the steady periodic solution x^p of Example 4.5.1 
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4.5.2 Resonance 

Just like when the forcing function was a simple cosine, resonance could still happen. Let us assume 
c = and we will discuss only pure resonance. Again, take the equation 

mx"(t) + kx(t) = F(t). 

When we expand F{t) and find that some of its terms coincide with the complementary solution to 
mx" + kx = 0, we cannot use those terms in the guess. Just like before, they will disappear when 
we plug into the left hand side and we will get a contradictory equation (such as = 1). That is, 
suppose 

Xc = A cos(ct>oO + B sin(a;oO> 
where <t>o = x some positive integer A'^. In this case we have to modify our guess and try 

/X / (Nn \ , . (Nn \\ /"^ \ , ■ /'^^ \ 

n=l 

In other words, we multiply the offending term by t. From then on, we proceed as before. 

Of course, the solution will not be a Fourier series (it will not even be periodic) since it con- 
tains these terms multiplied by t. Further, the terms t {a^ cos + sin will eventually 
dominate and lead to wild oscillations. As before, this behavior is called pure resonance or just 
resonance. 

Note that there now may be infinitely many resonance frequencies to hit. That is, as we change 
the frequency of F (we change L), different terms from the Fourier series of F may interfere with the 
complementary solution and will cause resonance. However, we should note that since everything 
is an approximation and in particular c is never actually zero but something very close to zero, only 
the first few resonance frequencies will matter. 

Example 4.5.2: Find the steady periodic solution to the equation 

2x" + 18;r^x = F{t), 

where 

F{t) 

extended periodically. We note that 

Fit) = V — sin(n;z-0. 
^ nn 

n=\ 
n odd 

Exercise 4.5.1; Compute the Fourier series ofFto verify the above equation. 



[-1 if-l<?<0, 
II if 0<t<l, 
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The solution must look like 

x(t) = ci cos(37rO + C2 sin(37rO + Xp(t) 

for some particular solution Xp. 

We note that if we just tried a Fourier series with sm(nnt) as usual, we would get duplication 
when n = 3. Therefore, we pull out that term and multiply by t. We also have to add a cosine term 
to get everything right. That is, we must try 

CO 

Xp(t) = fl3?cos(37rO + b^t sm(37rt) + ^ b„sm(n7rt). 

n=\ 
n odd 

Let us compute the second derivative. 
Xp(0 = -6a37r sin(37rO - 97r^a3 1 cos(37rO + ^h^n cos(37rO - ^it^h^ t sin(37rO+ 

CO 

+ ^ (-rp'n^bn) sin(n;rO. 

n=l 
n odd 

We now plug into the left hand side of the differential equation. 

2Xp + 187r^x = - 12a37rsin(37rO - ISn^a^t cos(3nt) + llbsn cos(3nt) - 1 871^^3? sin(3;rO+ 

+ 1872^03? cos(37rO + 187r^&3?sin(37rO+ 



+ ^(-2n^n^b„ + ISn^bJ sm(n7it). 



n=l 
n odd 



If we simplify we obtain 

00 

Ix'p + 187r^x = -12fl3;rsin(37r0 + 12&37rcos(37rO + 2(-2nV&„ + 187r^&„) sin(n7rO. 



n=l 
n odd 

This series has to equal to the series for F{t). We equate the coefficients and solve for and bn- 

_ 4/(37r) _ -]_ 

^3=0, 

4 2 
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That is, 



-pit) = ^ t cos(37rO + ^ 



■%(9 - 



2 



sin(n;rO. 



H odd 



When c > 0, you will not have to worry about pure resonance. That is, there will never be 
any conflicts and you do not need to multiply any terms by t. There is a corresponding concept of 
practical resonance and it is very similar to the ideas we already explored in chapter 2. We will not 
go into details here. 

4.5.3 Exercises 

Exercise 4.5.2; Let F{t) = \ + Yjn=i ^2 cos(nnt). Find the steady periodic solution to x" + 2x = F{t). 
Express your solution as a Fourier series. 

Exercise 4.5.3; Let F{t) = ^ sin(n7rf). Find the steady periodic solution to x" + x' + x = F{t). 
Express your solution as a Fourier series. 

Exercise 4.5.4; Let F{t) = ^ cos(nnt). Find the steady periodic solution to x" + 4x = F{t). 
Express your solution as a Fourier series. 

Exercise 4.5.5; Let F{t) = tfor -1 < t < 1 and extended periodically. Find the steady periodic 
solution to x" + X = F{t). Express your solution as a series. 

Exercise 4.5.6; Let F(t) = tfor -1 < t < 1 and extended periodically. Find the steady periodic 
solution to x" + n^x = F{t). Express your solution as a series. 

Exercise 4.5.101; Let F(t) = sin(2;r0 + 0.1 cos(107rO- Find the steady periodic solution to x" + 
V2 jc = Fit). Express your solution as a Fourier series. 

Exercise 4.5.102; Let F(t) = Yj7=i cos(2nt). Find the steady periodic solution to x" + 3a: = Fif). 
Express your solution as a Fourier series. 

Exercise 4.5.103; Let F(t) = \t\for -1 < t < 1 extended periodically. Find the steady periodic 
solution to x" + V3 X = F(t). Express your solution as a series. 

Exercise 4.5.104: Let F{t) = \t\for-l <t<\ extended periodically. Find the steady periodic 
solution to x" + n^x = Fit). Express your solution as a series. 
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4.6 PDEs, separation of variables, and the heat equation 

Note: 2 lectures, §9.5 in [EP], §10.5 in [BP] 

Let us recall that a partial differential equation or PDE is an equation containing the partial 
derivatives with respect to several independent variables. Solving PDEs will be our main application 
of Fourier series. 

A PDE is said to be linear if the dependent variable and its derivatives appear at most to the 
first power and in no functions. We will only talk about linear PDEs. Together with a PDE, we 
usually have specified some boundary conditions, where the value of the solution or its derivatives 
is specified along the boundary of a region, and/or some initial conditions where the value of the 
solution or its derivatives is specified for some initial time. Sometimes such conditions are mixed 
together and we will refer to them simply as side conditions. 

We will study three specific partial differential equations, each one representing a more general 
class of equations. First, we will study the heat equation, which is an example of a parabolic PDE. 
Next, we will study the wave equation, which is an example of a hyperbolic PDE. Finally, we will 
study the Laplace equation, which is an example of an elliptic PDE. Each of our examples will 
illustrate behavior that is typical for the whole class. 

4.6.1 Heat on an insulated wire 

Let us first study the heat equation. Suppose that we have a wire (or a thin metal rod) of length L 
that is insulated except at the endpoints. Let x denote the position along the wire and let t denote 
time. See Figure 4.13. 



temperature u 



L X 

insulation 



Figure 4.13: Insulated wire. 



Let u{x, t) denote the temperature at point x at time t. The equation governing this setup is the 
so-called one -dimensional heat equation: 

du d^u 
dt^ d^' 



where > is a constant (the thermal conductivity of the material). That is, the change in heat at a 
specific point is proportional to the second derivative of the heat along the wire. This makes sense; 
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if at a fixed t the graph of the heat distribution has a maximum (the graph is concave down), then 
heat flows away from the maximum. And vice- versa. 

We will generally use a more convenient notation for partial derivatives. We will write instead 
of ^, and we will write u^x instead of 0. With this notation the heat equation becomes 

Ui — kUxx- 

For the heat equation, we must also have some boundary conditions. We assume that the ends 
of the wire are either exposed and touching some body of constant heat, or the ends are insulated. 
For example, if the ends of the wire are kept at temperature 0, then we must have the conditions 

m(0, = and u{L, t) = 0. 

If, on the other hand, the ends are also insulated we get the conditions 

Ux(0, = and Ux(L, t) = 0. 

In other words, heat is not flowing in nor out of the wire at the ends. We always have two conditions 
along the x axis as there are two derivatives in the x direction. These side conditions are called 
homogeneous (that is, m or a derivative of u is set to zero). 

Furthermore, suppose that we know the initial temperature distribution at time t = 0. That is, 

u(x, 0) = fix), 

for some known function f(x). This initial condition is not a homogeneous side condition. 

4.6.2 Separation of variables 

The heat equation is linear as u and its derivatives do not appear to any powers or in any functions. 
Thus the principle of superposition still applies for the heat equation (without side conditions). If ui 
and U2 are solutions and ci, C2 are constants, then u = ciUi + C2U2 is also a solution. 

Exercise 4.6.1; Verify the principle of superposition for the heat equation. 

Superposition also preserves some of the side conditions. In particular, if wi and U2 are solutions 
that satisfy a(0, = and u(L, t) = 0, and ci, ci are constants, then u = ciUi + C2U2 is still a solution 
that satisfies m(0, = and u{L, t) = 0. Similarly for the side conditions M;t(0, = and Ux{L, t) = 0. 
In general, superposition preserves all homogeneous side conditions. 

The method of separation of variables is to try to find solutions that are sums or products of 
functions of one variable. For example, for the heat equation, we try to find solutions of the form 



u(x, = X(x)T(t). 
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That the desired solution we are looking for is of this form is too much to hope for. What is perfectly 
reasonable to ask, however, is to find enough "building-block" solutions of the form u{x, t) = 
X{x)T{t) using this procedure so that the desired solution to the PDE is somehow constructed from 
these building blocks by the use of superposition. 
Let us try to solve the heat equation 

Uf = kuxx with m(0, t) = 0, m(L, t) = 0, and u(x, 0) = f(x). 

Let us guess u(x, t) = X(x)T(t). We plug into the heat equation to obtain 

Xix)T'it) = kX"{x)T{t). 

We rewrite as 

r(o _ x"{x) 

kT(t) ~ X(x) ' 

This equation must hold for all x and all t. But the left hand side does not depend on x and the right 
hand side does not depend on t. Hence, each side must be a constant. Let us call this constant -A 
(the minus sign is for convenience later). We obtain the two equations 

no ^ _ , ^ x"(x) 

kT(t) X(x) ' 

In other words 

X"{x) + AX{x) = 0, 
T'it) + AkT{t) = 0. 

The boundary condition m(0, = implies X(0)T(t) = 0. We are looking for a nontrivial solution 
and so we can assume that T(t) is not identically zero. Hence X(0) = 0. Similarly, u{L, = 
implies X(L) = 0. We are looking for nontrivial solutions X of the eigenvalue problem X" + AX = 0, 
X(0) = 0, X(L) = 0. We have previously found that the only eigenvalues are An = for integers 
n> I, where eigenfunctions are sin ( ^ •^)- Hence, let us pick the solutions 

Ti' 

The corresponding r„ must satisfy the equation 

2 2 

T'nit) + "^kTnit) = 0. 

By the method of integrating factor, the solution of this problem is 



4. 6. PDES, SEPARATION OF VARIABLES, AND THE HEAT EQUATION 



193 



It will be useful to note that r„(0) = 1 . Our building-block solutions are 



Un(x,t) = X„{x)Tn(t) = sin( — x) e 



nn 



We note that u„(x, 0) = sin ( ^ '^)- Let us write f(x) as the sine series 

DO 

fix) = Yj^" ^^"(t^)' 



That is, we find the Fourier series of the odd periodic extension of f{x). We used the sine series as 
it corresponds to the eigenvalue problem for X{x) above. Finally, we use superposition to write the 
solution as 



DO DO 

u(x, t) = 2_j "nUn{x, f) = 2^ Sin — ;cj g 

;i=l ;i=l 



Why does this solution work? First note that it is a solution to the heat equation by superposition. 
It satisfies m(0, t) = and u{L, t) = 0, because x = or x = L makes all the sines vanish. Finally, 
plugging in ? = 0, we notice that r„(0) = 1 and so 



OO CO 

u(x, 0) = ^ bnUnix, 0) = ^ Z7„ sin (y- ^) = fix) 

n=l n=l 



Example 4.6.1: Suppose that we have an insulated wire of length 1, such that the ends of the wire 
are embedded in ice (temperature 0). Let k = 0.003. Then suppose that initial heat distribution is 
uix, 0) = 50xil-x). See Figure 4.14. 




Figure 4.14: Initial distribution of temperature in the wire. 
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We want to find the temperature function u(x, t). Let us suppose we also want to find when (at 
what t) does the maximum temperature in the wire drop to one half of the initial maximum of 12.5. 
We are solving the following PDE problem: 

Ut = 0.003 Uxx, 
m(0,0 = u(l,t) = 0, 

u(x,0) = 50x(\ - x) forO<x<l. 
We write f{x) = 50;c(l - ;c) for < ;ic < 1 as a sine series. That is, f{x) = Yj7=i sm{nnx), where 




Figure 4. 15: Plot of the temperature of the wire at position x at time t. 



The solution u{x, t), plotted in Figure 4.15 for Q <t < 100, is given by the series: 



u{x,t)= y ^sin(^7r;c)e-"''^'°■°°3^ 

n=l 
n odd 
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Finally, let us answer the question about the maximum temperature. It is relatively easy to see 
that the maximum temperature will always be at x = 0.5, in the middle of the wire. The plot of 
u{x, t) confirms this intuition. 

If we plug in jc = 0.5 we get 

u{0.5,t)= y ^sin(n;r0.5)e-"'^'°°''^^^ 

n=\ 
n odd 

For n = 3 and higher (remember n is only odd), the terms of the series are insignificant compared 
to the first term. The first term in the series is already a very good approximation of the function. 
Hence 

The approximation gets better and better as t gets larger as the other terms decay much faster. Let 
us plot the function m(0.5, f), the temperature at the midpoint of the wire at time t, in Figure 4.16. 
The figure also plots the approximation by the first term. 




Figure 4.16: Temperature at the midpoint of the wire (the bottom curve), and the approximation of 
this temperature by using only the first term in the series (top curve). 



After ? = 5 or so it would be hard to tell the diff"erence between the first term of the series for 
m(x, f) and the real solution u{x, t). This behavior is a general feature of solving the heat equation. If 
you are interested in behavior for large enough only the first one or two terms may be necessary. 

Let us get back to the question of when is the maximum temperature one half of the initial 
maximum temperature. That is, when is the temperature at the midpoint 12.5/2 = 6.25. We notice on 
the graph that if we use the approximation by the first term we will be close enough. We solve 
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That is. 



i„ 6.25 n'^ 

t = « 24.5. 



-;r20.003 

So the maximum temperature drops to half at about t = 24.5. 

We mention an interesting behavior of the solution to the heat equation. The heat equation 
"smoothes" out the function /(x) as t grows. For a fixed t, the solution is a Fourier series with 

coefficients b„e . If f > 0, then these coefficients go to zero faster than any for any power 
p. In other words, the Fourier series has infinitely many derivatives everywhere. Thus even if the 
function f{x) has jumps and comers, then for a fixed ? > 0, the solution u{x, t) as a function of x is 
as smooth as we want it to be. 



4.6.3 Insulated ends 

Now suppose the ends of the wire are insulated. In this case, we are solving the equation 

Ut = kuxx with Ux{Q,t) = Q, Ux(L,t) = 0, and u(x,0) = f{x). 

Yet again we try a solution of the form u{x, t) = X{x)T{t). By the same procedure as before we plug 
into the heat equation and arrive at the following two equations 

X"(x) + AX(x) = 0, 
r (0 + AkT(t) = 0. 

At this point the story changes slightly. The boundary condition u^dO, t) = implies X'(0)T(t) = 0. 
Hence X'(0) = 0. Similarly, u^iL, = implies X'(L) = 0. We are looking for nontrivial solutions 
X of the eigenvalue problem X" + AX = 0, X'(0) = 0, X'(L) = 0. We have previously found that the 
only eigenvalues are /!„ = for integers n > 0, where eigenfunctions are cos (jf xj (we include 
the constant eigenf unction). Hence, let us pick solutions 

— xj and Xo(x) = 1. 

The corresponding r„ must satisfy the equation 

2 2 

Kit) + "^kTnit) = 0. 

Forn > 1, as before, 

T„(t) = e^'". 

For n = 0, we have 7^(0 = and hence ro(0 = 1. Our building-block solutions will be 

(nn \ -n^"^ j.f 
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and 

Uo{x,t) = 1. 

We note that u„(x, 0) = cos x^. Let us write / using the cosine series 



DO 

fix) = Y + ^ a„ COS . 

n=l 



That is, we find the Fourier series of the even periodic extension of f{x). 
We use superposition to write the solution as 



u{x, = Y + 2j ^«""(-^' = Y + 2j a« COS y— xj e l2 . 



n=l n=l 



Example 4.6.2: Let us try the same equation as before, but for insulated ends. We are solving the 
following PDE problem 

Ut = 0.003 Uxx, 

uMt) = = 0, 

u(x,0) = 50x{\ - x) forO<x<l. 

For this problem, we must find the cosine series of u{x, 0). For < jc < 1 we have 



50x{l - x) = Y + 2j I I cos(n7rx). 

n even 



The calculation is left to the reader. Hence, the solution to the PDE problem, plotted in Figure 4.17 
on the next page, is given by the series 



25 

y 



n even 



u(x, t) = =-+ > ■ I I cos(nnx) e-"'-'o o«3^_ 



Note in the graph that the temperature evens out across the wire. Eventually, all the terms except 

15 
3 



the constant die out, and you will be left with a uniform temperature of ^ « 8.33 along the entire 



length of the wire. 



4.6.4 Exercises 

Exercise 4.6.2; Imagine you have a wire of length 2, with k = 0.001 and an initial temperature 
distribution ofu{x, 0) = 50x Suppose that both the ends are embedded in ice (temperature 0). Find 
the solution as a series. 
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0.00 ' 




I |u(x,t) 



1 1 .700 
10.400 
H9.100 
7.800 
6.500 
H 5.200 
3.900 
H 2.600 
1.300 
0.000 



il.OO 



Figure 4.17: Plot of the temperature of the insulated wire at position x at time t. 
Exercise 4.6.3; Find a series solution of 

Uf = Uxxt 

u(0,t) = u(l,t) = 0, 

a(x,0) = 100 forO<x<l. 

Exercise 4.6.4; Find a series solution of 



Ut — Uxxi 

Ux(0, t) = Ux{n, t) = 0, 

u(x, 0) = 3 cos(jc) + cos(3a:) for < x < n. 
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Exercise 4.6.5; Find a series solution of 

_ 1 

u^(0, t) = Uj,{n, t) = 0, 
lOx 

u(x, 0) = for < X < n. 

n 

Exercise 4.6.6; Find a series solution of 

Uf = Uxxt 

m(0,0 = 0, m(1,0 = 100, 

uix, 0) = sm{nx) for Q < x < 1 . 

Hint: Use the fact that u{x, t) = lOOx is a solution satisfying Ut = Uxx, u(0, t) = 0, m(1, t) = 100. 
Then use superposition. 

Exercise 4.6.7; Find the steady state temperature solution as a function ofx alone, by letting t ^ oo 
in the solution from exercises 4.6.5 and 4.6.6. Verify that it satisfies the equation Uxx = 0. 

Exercise 4.6.8; Use separation variables to find a nontrivial solution to Uxx + Uyy = 0, where 
u(x, 0) = and u(0,y) = 0. Hint: Try u(x,y) = X(x)Y(y). 

Exercise 4.6.9 (challenging); Suppose that one end of the wire is insulated (say at x = 0) and the 
other end is kept at zero temperature. That is, find a series solution of 

Uf = kUxxi 

UxiO, t) = u{L, t) = 0, 

u{x, 0) = fix) for < X <L. 

Express any coefficients in the series by integrals of f{x). 

Exercise 4.6.10 (challenging); Suppose that the wire is circular and insulated, so there are no ends. 
You can think of this as simply connecting the two ends and making sure the solution matches up at 
the ends. That is, find a series solution of 

Ut = kUxxi 

u(0, t) = u(L, t), Ux{Q, t) = Ux{L, t), 
u(x, 0) = fix) for < X < L. 

Express any coefficients in the series by integrals of fix). 



200 



CHAPTER 4. FOURIER SERIES AND PDES 



Exercise 4.6.101; Find a series solution of 

Ut = 3Uxx, 

u(0, t) = u(n, t) = 0, 

u(x, 0) = 5 sin(x) + 2 sin(5x) for < x < n. 
Exercise 4.6.102; Find a series solution of 

U, = O.lUxx, 

Ux(0, t) = Ux(7T, t) = 0, 

u(x, 0) = 1 + 2 cos(x) for < x < n. 
Exercise 4.6.103; Use separation of variables to find a nontrivial solution to u^t = u^x- 

Exercise 4.6.104; Use separation of variables (Hint: try u(x, t) = X(x) + T(t)) to find a nontrivial 
solution to Ux + Ut = u. 
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4.7 One dimensional wave equation 

Note: 1 lecture, §9.6 in [EPJ, §10.7 in [BP] 

Imagine we have a tensioned guitar string of length L. Suppose we only consider vibrations in 
one direction. That is, let x denote the position along the string, let t denote time, and let y denote 
the displacement of the string from the rest position. See Figure 4.18. 



y' 




^^^^\ 


^^^^ 

y ^^^^^ 





L X 



Figure 4.18: Vibrating string. 



The equation that governs this setup is the so-called one-dimensional wave equation: 



ytt = a^yxx, 

for some constant a > 0. Assume that the ends of the string are fixed in place: 

3^(0, = and y(L, t) = 0. 

Note that we have two conditions along the x axis as there are two derivatives in the x direction. 

There are also two derivatives along the t direction and hence we need two further conditions 
here. We need to know the initial position and the initial velocity of the string. That is, 

y(x, 0) = f(x) and yt(x, 0) = g(x), 

for some known functions f{x) and g(x). 

As the equation is again linear, superposition works just as it did for the heat equation. And 
again we will use separation of variables to find enough building-block solutions to get the overall 
solution. There is one change however. It will be easier to solve two separate problems and add 
their solutions. 

The two problems we will solve are 

Wtt = a^Wjcj,, 
w(0, t) = w(L, t) = 0, 
w(x, 0) = 
Wt{x, 0) = g{x) 



for < X < L, 
for < X < L. 



(4.10) 
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and 

_ 2 
Ztt — CI Zxxi 

z{0,t) = z{ht) = Q, 

z{x, 0) = fix) for < X < L, ^ ' 

Zt(x, 0) = for < x < L. 

The principle of superposition implies that y = w + z solves the wave equation and furthermore 
y(x, 0) = w(x, 0) + z(x, 0) = fix) and yt(x, 0) = Wt(x, 0) + Zt(x, 0) = g(x). Hence, y is a solution to 

ytt = a^yxx, 

y{0,t)=y(L,t) = 0, 

y(x, 0) = fix) for < jc < L, ^ ^ ^ 

yt(x, 0) = g(x) for < jc < L. 

The reason for all this complexity is that superposition only works for homogeneous conditions 
such as y(0, t) = y{L, t) = 0, y{x, 0) = 0, or yt{x, 0) = 0. Therefore, we will be able to use the 
idea of separation of variables to find many building-block solutions solving all the homogeneous 
conditions. We can then use them to construct a solution solving the remaining nonhomogeneous 
condition. 

Let us start with (4.10) . We try a solution of the form w{x, t) = X{x)T{t) again. We plug into the 
wave equation to obtain 

X(x)T"(t) = a^X"(x)T(t). 

Rewriting we get 

T"{t) _ X"(x) 
d^Tit) ~ X{x) ■ 

Again, left hand side depends only on t and the right hand side depends only on x. Therefore, both 
equal a constant, which we will denote by -A. 

T"{t) ^ _^ ^ X"{x) 



d^T{t) X{x) 
We solve to get two ordinary differential equations 

X"{x) + AX{x) = 0, 
T"{t) + Aa^T(t) = 0. 

The conditions = w(0, t) = X(0)T(t) implies X(0) = and w(L, = implies that X(L) = 0. 

2 2 

Therefore, the only nontrivial solutions for the first equation are when A = An = ^ and they are 

/nn \ 

Xn{x) = sm( — ;cl. 

The general solution for T for this particular /l„ is 

^ . s . /nna \ „ . /nna \ 
Tn(t) = A cos tj + B sm tj . 
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We also have the condition that w(x, 0) = or X(x)T(0) = 0. This implies that r(0) = 0, which in 
turn forces A = 0. It is convenient to pick B = (you will see why in a moment) and hence 

Tn(t) = smi — t). 

nna \ L I 

Our building-block solutions are 

L Inn \ (nna 

Wnix, t) = sm — x] sm 

nna \ L I 



■ /"^ \ (nna \ 
{x, t) = sm I — x \ cos I ^ I • 

(nn \ 
(x, 0) = ^my— xy 



We differentiate in t, that is 

dt 

Hence, 

dWn , . (nn 

We expand g{x) in terms of these sines as 

CO 

n=l 

Using superposition we can just write down the solution to (4.10) as a series 

oo DO _ 

Zv-\ L (nn \ (nna \ 



Exercise 4.7.1; Check that w{x, 0) = and Wt{x, 0) = g{x). 

Similarly we proceed to solve (4.11) . We again try z{x,y) = X(x)T(t). The procedure works 
exactly the same at first. We obtain 

X"ix) + AXix) = 0, 
T"{t) + Aa^T{t) = 0. 

and the conditions X(0) = 0, X{L) = 0. So again A = An = ^ and 

(nn \ 
— xj . 

This time the condition on T is r'(0) = 0. Thus we get that 5 = and we take 

^ ^ ^ (nna 
T„{t) = cos 
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Our building-block solution will be 

. (nn \ inna \ 
Zn(x,t) = sinl — xl cosi — n. 

We expand f(x) in terms of these sines as 

CO 

fix) = sin ( Y -^j • 

n=\ 

And we write down the solution to (4.11) as a series 

DO OO 

Zv-' Inn \ (nna \ 

CnZnix, t) = 2_^Cn Sin I — X I COS I — 1 1 . 



n=\ 



n=\ 



Exercise 4.7.2; Fill in the details in the derivation of the solution of (4.11) . Check that the solution 
satisfies all the side conditions. 

Putting these two solutions together, let us state the result as a theorem. 

Theorem 4.7.1. Take the equation 



y{Q,t)=y{L,t) = Q, 
y{x,Q) = f{x) 
yt{x, 0) = g{x) 



for < X < L, 
forO < X < L, 



(4.13) 



where 



and 



OO 

f{x) = Yj Cn sin ( Y ^) ' 

OO 

g{x) = ^K^mi^x^. 

n=l 

Then the solution y{x, t) can be written as a sum of the solutions of (4.10) and (4.11) . In other 
words, 



, ^ • l^^ \ ■ (nna \ . (nn \ (nna 
y(x, = ^ b„ sm I — X I sm I tj + Cn sm I — .x: I cos I ^ 

n=l 

Z. (nn \ r, L . (nna \ 
sm — x] On sm n + c„ cc 
\L I I nna \ L I 
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Example 4.7.1: Let us try a simple example of a plucked string. Suppose that a string of length 2 
is plucked in the middle such that it has the initial shape given in Figure 4.19. That is 



\OAx ifO<x<l, 
l0.1(2-;c) ifl<;c<2. 



The string starts at rest {g{x) = 0). Suppose that a = 1 in the wave equation for simplicity. 
We leave it to the reader to compute the sine series of fix). The series will be 



0.8 

n=l 

Note that sin (yj is the sequence 1,0, -1,0, 1, 0, -1, ... for « = 1, 2, 3, 4, . . .. Therefore, 



0.8 . (n \ 0.8 . I3n \ 0.8 . (Sn \ 
fix) = ^ (-.)-— sm ^- .| + ^ sm ^- .j 



The solution yix, t) is given by 
0.8 



ZO.o . (nn\ . (nn \ Inn \ 
-^sm(-) sm(-x)cos(-.) 

n=l 

_ ^ 0.8(-l)™+' (i2m - \)n \ _ (ilm - \)7t 



_ sm .x: cos , 

2;r2 2 2 



^ (2m- ir;r2 

0.8 . (n \ (n \ 0.8 . (3n \ (3n \ 0.8 . (5n \ l5n \ 
= - sm (- .) cos (- - — sm ^- .j cos + ^ sm ^- .| cos ^- r| - • • • 

A plot for < ? < 3 is given in Figure 4.20 on the following page. Notice that unlike the heat 
equation, the solution does not become "smoother," the "sharp edges" remain. We will see the 
reason for this behavior in the next section where we derive the solution to the wave equation in a 
different way. 

Make sure you understand what the plot, such as the one in the figure, is telling you. For each 
fixed t, you can think of the function yix, t) as just a function of x. This function gives you the shape 
of the string at time t. 
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Figure 4.20: Shape of the plucked string for < ? < 3. 



4.7.1 Exercises 

Exercise 4.7.3; Solve 



Jtt = 9jxt, 

y{0,t)=y{\,t) = Q, 

y{x, 0) = sin(3;rx) + \ sin(6;rx) 

^.(.^,0) = 



Exercise 4.7.4: Solve 



ytt = ^jxx, 

y{Q,t)=y{\,t) = Q, 

y{x, 0) = sin(3;rx) + ^ sin(6;rx) 



forO < jc < 1, 
forO < X <l. 



forO < X < \, 
for < X < 1 . 



ytix, 0) = sm(9nx) 

Exercise 4.7.5; Derive the solution for a general plucked string of length L, where we raise the 
string some distance b at the midpoint and let go, and for any constant a ( in the equation y„ = cp-y^x)- 



4. 7. ONE DIMENSIONAL WAVE EQUATION 



207 



Exercise 4.7.6; Imagine that a stringed musical instrument falls on the floor. Suppose that the 
length of the string is 1 and a = \. When the musical instrument hits the ground the string was in 
rest position and hence y{x, 0) = 0. However, the string was moving at some velocity at impact 
(t = 0), say yt(x, 0) = -1. Find the solution y(x, t)for the shape of the string at time t. 

Exercise ^.1.1 (challenging); Suppose that you have a vibrating string and that there is air resis- 
tance proportional to the velocity. That is, you have 

ytt = a^jxx - ht, 

y{Q,t)=y{\,t) = Q, 

y(x,0)=fix) forO<x<l, 
y,(x,0) = forO<x<l. 

Suppose that < k < 2na. Derive a series solution to the problem. Any coefficients in the series 
should be expressed as integrals off(x). 

Exercise 4.7.101; Solve 

ytt — yxxi 

y(0,t)=y(7:,t) = Q, 

y{x, 0) = sin(jc) for < x <n, 

yt{x, 0) = sin(jc) for Q < x <?:. 

Exercise 4.7.102; Solve 

ytt = '25y;cx, 

y(0,t) = y(2,t) = 0, 

y(x, 0) = for0<x<2, 
yi(x, 0) = sin(;rO + 0.1 sin(2;r0 for < x<2. 

Exercise 4.7.103; Solve 

ytt — 2yxx5 

y(0,t) = y(n,t) = 0, 

y(x, 0) = X for < x < n, 

yt(x, 0) = for < x < n. 

Exercise 4.7.104; Let's see what happens when a = 0. Find a solution to y^ = 0, y(0, t) = y(7T, t) = 0, 
y(x, 0) = sin(2x), yt(x, 0) = sin(x). 
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4.8 D'Alembert solution of the wave equation 

Note: 1 lecture, different from §9.6 in [EP], part of §10.7 in [BP] 

We have solved the wave equation by using Fourier series. But it is often more convenient to 
use the so-called d'Alembert solution to the wave equation* . This solution can be derived using 
Fourier series as well, but it is really an awkward use of those concepts. It is much easier to derive 
this solution by making a correct change of variables to get an equation that can be solved by simple 
integration. 

Suppose we have the wave equation 

ytt = a^yxx- (4.14) 
And we wish to solve the equation (4.14) given the conditions 

y{Q, t) = y(L, = for all t, 

yix,0) = fix) 0<x<L, (4.15) 

yt(x, 0) = g(x) < X < L. 



4.8.1 Change of variables 

We will transform the equation into a simpler form where it can be solved by simple integration. 
We change variables to ^ = x - at, rj = x + at and we use the chain rule: 

d _d^ d dj] d _ d d 
dx dxd^ dxdr] drj' 

d _d^ d dri d _ d d 
dt ~ 'dtd^ ^ 'dtd^ ~ ~^d^^^d^' 



We compute 



dx^ dT])\d^ Ot]) ae d^dj] drf' 

d'y I 9 d\l dy dy\ ,d^y ^ ^ d^y ,_d^y 



dt^ \ dr])\ drj) d^drj drf 

In the above computations, we have used the fact from calculus that = Then we plug into 
the wave equation, 

2 2 ^^y 2 

= a yxx - ytt = 4a"— T- = 4a y^r,- 



*Named after the French mathematician Jean le Rond d'Alembert (1717 - 1783). 
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Therefore, the wave equation (4.14) transforms into y^r] = 0. It is easy to find the general solution 
to this equation by integrating twice. Let us integrate with respect to j] first* and notice that the 
constant of integration depends on ^. We get = C(^). Next, we integrate with respect to ^ and 
notice that the constant of integration must depend on 77. Thus, y = /C(^) + B{ri). The solution 
must, therefore, be of the following form for some functions A(^) and 5(?7): 



y = A(^) + 5(77) = A{x - at) + B(x + at). 



4.8.2 The formula 

We know what any solution must look like, but we need to solve for the given side conditions. We 
will just give the formula and see that it works. First let F(x) denote the odd extension of f{x), and 
let G{x) denote the odd extension of g{x). Define 



A(x) 



^Fx) ^ r 

2 2a Jo 



G(s) ds. 



B(x) = ^F{x) + 



2a Jo 



G{s) ds. 



We claim this A{x) and B{x) give the solution. Explicitly, the solution is y(x, t) = A{x-at) + B{x + at) 
or in other words: 



px-at 2 Y r'X+at 

y{x, t) = -F{x - at) - — \ G(s) ds + -F{x + at) + — I G{s) ds 
2 2a Jo 2 2a Jo 



F{x - at) + F{x + 



at) 1 r 

2a 



G(s) ds. 



(4.16) 



Let us check that the d'Alembert formula really works. 

y(x, 0) = l-F(x) [ G(s) ds + l-F(x) + ^ f G(s) ds = F(x). 

2 2a Jo 2 2a Jo 

So far so good. Assume for simplicity F is difl^erentiable. By the fundamental theorem of calculus 
we have 



So 



—a , 1 a , 1 

yt{x, t) = —F {x - at) + -jG{x - at) + -F {x + at) + -jGix + at). 



y,{x,Q) = -^F'{x) + ^GW + ^F'{x) + ^GW = G{x). 



Yay! We're smoking now. OK, now the boundary conditions. Note that F{x) and G{x) are odd. 
Also ^ G{s) ds is an even function of x because G{x) is odd (to see this fact, do the substitution 



*We can just as well integrate with ^ first, if we wish. 



210 



CHAPTER 4. FOURIER SERIES AND PDES 



s = -v). So 

1 1 r"" 1 1 r' 

yiO,t) = -Fi-at)-— Gis) ds + -F(at) + — G{s) ds 

2 la Jo 2 la Jo 

-1 1 r' 1 1 r' 

= — F(at) G{s) ds + -F{at) + — G{s) ds = 0. 

2 la Jo 2 2a Jo 

Note that F(x) and G{x) are 2L periodic. We compute 

y(L, t) = -F(L -at)- — I G(^) + -F(L + at) + — I G(5) ds 
1 la Jo 1 la Jo 

1 1 1 f""' 

= -F(-L -at) - — Gis) ds- — I Gis) ds + 
1 la Jo la Jo 

1 1 1 r' 

+ -FiL + at) + — Gis) ds + — \ Gis) ds 
1 la Jn la 



I r 1 r 

- Gis)ds + — 
-a Jo 2a Jo 

-1 1 r" 1 1 C" 

= —FiL + at)- — Gis)ds + -FiL + at) + — 
1 la Jo 2 2a Jo 



Gis) ds = 0. 



And voila, it works. 



Example 4.8.1: What the d' Alembert solution says is that the solution is a superposition of two 
functions (waves) moving in the opposite direction at "speed" a. To get an idea of how it works, let 
us do an example. Suppose that we have the simpler setup 

ytt = jxx, 

yiQ,t)=yil,t) = Q, 
yix,0) = fix), 
ytix,0) = 0. 

Here fix) is an impulse of height 1 centered at x = 0.5: 



fix) = 



if < ;c < 0.45, 

20 0.45) if < ;c < 0.45, 

20 (0.55 -;c) if 0.45 < jc < 0.55, 

if0.55<jc<l. 



The graph of this pulse is the top left plot in Figure 4.21 on the next page. 

Let Fix) be the odd periodic extension of fix). Then from (4.16) we know that the solution is 
given as 

Fix -t) + Fix + t) 
yix,t) = ■ 
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It is not hard to compute specific values of y(x, t). For example, to compute y(0.1, 0.6) we notice 
x-t = -0.5 and X + ? = 0.7. Now F(-0.5) = -/(0.5) = -20(0.55 - 0.5) = -1 and F(0.7) = 
/(0.7) = 0. Hence j(0. 1,0.6) = -y^ = -0.5. As you can see the d'Alembert solution is much easier 
to actually compute and to plot than the Fourier series solution. See Figure 4.21 for plots of the 
solution y for several different t. 



0.00 0.25 0.50 0.75 1.00 0.00 0.25 0.50 0.75 1.00 




0.00 0.25 0.50 0.75 1.00 0.00 0.25 0.50 0.75 1.00 
0.00 (125 050 075 1X10 0.00 Ch25 050 075 U)0 




0.00 0.25 0.50 0.75 1.00 0.00 0.25 0.50 0.75 1.00 



Figure 4.21: Plot of the d'Alembert solution for f = 0, f = 0.2, t = 0.4, and t = 0.6. 



4.8.3 Notes 

It is perhaps easier and more useful to memorize the procedure rather than the formula itself. The 
important thing to remember is that a solution to the wave equation is a superposition of two waves 
traveling in opposite directions. That is. 



y(x, t) = A{x - at) + B{x + at). 
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If you think about it, the exact formulas for A and B are not hard to guess once you realize what 
kind of side conditions y{x, t) is supposed to satisfy. Let us give the formula again, but slightly 
differently. Best approach is to do this in stages. When g{x) = (and hence G{x) = 0) we have the 
solution 

F(x - at) + F(x + at) 
2 ■ 

On the other hand, when f{x) = (and hence F(x) = 0), we let 



H{x) = I Gis) ds. 

The solution in this case is 



Jo 



1 f 

2a Jx-. 



-H(x - at) + H(x + at) 



G{s) ds 



2^! Jx-at 2fl 

By superposition we get a solution for the general side conditions (4.15) (when neither f(x) nor 
g(x) are identically zero). 

F(x - at) + F(x + at) -H(x - at) + H(x + at) 

y(x, t) = + . (4.17) 

2 2a 
Do note the minus sign before the H, and the a in the second denominator. 

Exercise 4.8.1; Check that the new formula (4.17) satisfies the side conditions (4.15) . 

Warning: Make sure you use the odd extensions F(x) and G(x), when you have formulas for 
f(x) and g(x). The thing is, those formulas in general hold only for < x < L, and are not usually 
equal to F{x) and G{x) for other x. 



4.8.4 Exercises 

Exercise 4.8.2; Using the dAlembert solution solve jn = 4yxx, < x < n, t > 0, y(0, t) = y{n, t) = 0, 
y(x, 0) = sin x, and yt(x, 0) = sin x. Hint: Note that sin x is the odd extension ofy(x, 0) and yt(x, 0). 

Exercise 4.8.3; Using the dAlembert solution solve y^ = 1y^^, < x < 1, ? > 0, y(0, = ^(1, = 0, 
y(^, 0) = sin^(7rjc), andyt{x,Q)) = %\xi'{nx). 

Exercise 4.8.4; Take y^ = Ay,^,^, Q < x < n, t > y(0, t) = y{n, t) = 0, y{x, 0) = x(n - x), and 
yt{x,^) = 0. a) Solve using the dAlembert formula. Hint: You can use the sine series for y(x,0). b) 
Find the solution as a function of x for a fixed t = 0.5, t = I, and t = 2. Do not use the sine series 
here. 

Exercise 4.8.5; Derive the dAlembert solution for ytt = a^yxx, < x < tt, ? > 0, j(0, t) - yiji, t) = 0, 
y(x, 0) = f(x), andytix, 0) = 0, using the Fourier series solution of the wave equation, by applying 
an appropriate trigonometric identity. 
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Exercise 4.8.6; The d'Alembert solution still works if there are no boundary conditions and the 
initial condition is defined on the whole real line. Suppose that ju = yxx (far all x on the real line 
and t>Q), y{x, 0) = f{x), and yt{x, 0) = 0, where 

if x< -1, 

x+1 if -l<x<0, 
-x + l if < jc < 1, 
if x>l. 

Solve using the d'Alembert solution. That is, write down a piecewise definition for the solution. 
Then sketch the solution for t = 0, t = ^/2, t = I, and t = 2. 

Exercise 4.8.101; Using the dAlembert solution solve y„ = 9yxx, < x < I, t > 0, y(0, t) = 
y(l, = 0, y(x, 0) = sin(27rx), andy^x, 0) = sin(37rx). 

Exercise 4.8.102; Take y„ = Ay^x, < x < \, t > 0, y{0,t) = y{\,t) = Q, y{x,0) = x - x^, and 
yt{x, 0) = 0. Using the DAlembert solution find the solution at a) t = 0.1, b) t = ^2, c) t = I. You 
may have to split your answer up by cases. 

Exercise 4.8.103; Take yn = lOOyxx, < x < 4, t > 0, y(0,t) = y(4,t) = 0, y(x,0) = F(x), and 
ydx, 0) = 0. Suppose that F(0) = 0, F(l) = 2, F(2) = 3, F(3) = 1. Using the DAlembert solution 
finda)y(l,l),b)y(4,3),c)y(3,9). 
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4.9 Steady state temperature and the Laplacian 

Note: 1 lecture, §9.7 in [BP], §10.8 in [BDJ 

Suppose we have an insulated wire, a plate, or a 3-dimensional object. We apply certain fixed 
temperatures on the ends of the wire, the edges of the plate, or on all sides of the 3-dimensional 
object. We wish to find out what is the steady state temperature distribution. That is, we wish to 
know what will be the temperature after long enough period of time. 

We are really looking for a solution to the heat equation that is not dependent on time. Let us 
first solve the problem in one space variable. We are looking for a function u that satisfies 

but such that Ut = for all x and t. Hence, we are looking for a function of x alone that satisfies 
Uxx = 0. It is easy to solve this equation by integration and we see that u = Ax + B for some 
constants A and B. 

Suppose we have an insulated wire, and we apply constant temperature Ti at one end (say where 
X = 0) and T2 on the other end (at jc = L where L is the length of the wire). Then our steady state 
solution is 

T2 - Ti 
u{x) = — X + Ti. 

This solution agrees with our common sense intuition with how the heat should be distributed in the 
wire. So in one dimension, the steady state solutions are basically just straight lines. 

Things are more complicated in two or more space dimensions. Let us restrict to two space 
dimensions for simplicity. The heat equation in two variables is 

Mr = ^(Mxx + %•), (4.18) 

or more commonly written as a, = kbai or Ut = kV^u. Here the A and symbols mean £2 + 
We will use A from now on. The reason for using such a notation is that you can define A to be the 
right thing for any number of space dimensions and then the heat equation is always Ut = kAu. The 
operator A is called the Laplacian. 

OK, now that we have notation out of the way, let us see what does an equation for the steady 
state solution look like. We are looking for a solution to (4.18) that does not depend on t. Hence we 
are looking for a function u(x, y) such that 

Au = Uxx + Hyy = 0- 

This equation is called the Laplace equation*. Solutions to the Laplace equation are called harmonic 
functions and have many nice properties and applications far beyond the steady state heat problem. 

Harmonic functions in two variables are no longer just linear (plane graphs). For example, 
you can check that the functions jc^ - y'^ and xy are harmonic. However, if you remember your 



*Named after the French mathematician Pierre-Simon, marquis de Laplace (1749 - 1827). 
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multi-variable calculus we note that if u^x is positive, u is concave up in the x direction, then Uyy 
must be negative and u must be concave down in the y direction. Therefore, a harmonic function can 
never have any "hilltop" or "valley" on the graph. This observation is consistent with our intuitive 
idea of steady state heat distribution; the hottest or coldest spot will not be inside. 

Commonly the Laplace equation is part of a so-called Dirichlet problem* . That is, we have a 
region in the xj-plane and we specify certain values along the boundaries of the region. We then try 
to find a solution u defined on this region such that u agrees with the values we specified on the 
boundary. 

For simplicity, we consider a rectangular region. Also for simplicity we specify boundary values 
to be zero at 3 of the four edges and only specify an arbitrary function at one edge. As we still have 
the principle of superposition, we can use this simpler solution to derive the general solution for 
arbitrary boundary values by solving 4 different problems, one for each edge, and adding those 
solutions together. This setup is left as an exercise. 

We wish to solve the following problem. Let h and w be the height and width of our rectangle, 
with one comer at the origin and lying in the first quadrant. 

(0,/z) A 







Aw = 0, 




(4.19) 


u{0,y) = 


for < J < h. 


(4.20) 


u(x, h) = 


for < X < w, 


(4.21) 


u(w,y) = 


for < y < h. 


(4.22) 


u(x, 0) 


fix) for < .Jc < w. 


(4.23) 



M = 



(0,0) 




u = fix) 



iw,h) 



u = 



iw,0) 



The method we apply is separation of variables. Again, we will come up with enough building- 
block solutions satisfying all the homogeneous boundary conditions (all conditions except (4.23) ). 
We notice that superposition still works for the equation and all the homogeneous conditions. 
Therefore, we can use the Fourier series for fix) to solve the problem as before. 

We try uix,y) = Xix)Yiy). We plug u into the equation to get 

x"Y + xr' = 0. 

We put the Xs on one side and the Ys on the other to get 

X" _ Y" 
~T ~ T' 

The left hand side only depends on x and the right hand side only depends on y. Therefore, there is 
some constant X such that X 



-X" 
X 



Y" 



y . And we get two equations 
X" + XX = 0, 
Y" - .17 = 0. 



*Named after the German mathematician Johann Peter Gustav Lejeune Dirichlet (1805 - 1859). 
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Furthermore, the homogeneous boundary conditions imply that X(0) = X(w) = and Y(h) = 0. 
Taking the equation for X we have already seen that we have a nontrivial solution if and only if 

2 

A = A„ = ^ and the solution is a multiple of 

— xj . 

For these given A^, the general solution for Y (one for each n) is 

(nTT \ /nil \ 

—y] + B„sinh{—y]. (4.24) 

We only have one condition on Y„ and hence we can pick one of A„ or B„ to be something convenient. 
It will be useful to have ^,,(0) = 1, so we let A„ = 1. Setting Y„{h) = and solving for B„ we get that 



-cosh(^^) 



sinh(i^) 

After we plug the A„ and B„ we into (4.24) and simplify, we find 

sinh(2^) 



Yniy) = 



sinh(^^) 



We define u„(x,y) = X„(x)Y„(y). And note that m„ satisfies (4.19) - (4.22) . 
Observe that 



Suppose 



—xj. 

oo 

/(x) = 2,^«sm^— j. 



Then we get a solution of (4.19) - (4.23) of the following form. 




As Un satisfies (4.19) - (4.22) and any linear combination (finite or infinite) of m„ must also satisfy 
(4.19) - (4.22) , we see that u must satisfy (4.19) - (4.22) . By plugging in j = it is easy to see that u 
satisfies (4.23) as well. 
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Example 4.9.1: Suppose that we take w = h = n and we let f{x) = n. We compute the sine series 
for the function n (we will get the square wave). We find that for < jc < tt we have 



4 

fix) = ) - sm(nx). 



n odd 



Therefore the solution u{x,y), see Figure 4.22, to the corresponding Dirichlet problem is given as 

'sinh(n(;7r - y)y 



Z4 /s 
- ^m{nx) I - 

«=i ^ 

n odd 



sinh(n;7r) 




Figure 4.22: Steady state temperature of a square plate with three sides held at zero and one side 
held at n. 



This scenario corresponds to the steady state temperature on a square plate of width n with 3 
sides held at degrees and one side held at n degrees. If we have arbitrary initial data on all sides, 
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then we solve four problems, each using one piece of nonhomogeneous data. Then we use the 
principle of superposition to add up all four solutions to have a solution to the original problem. 

A different way to visualize solutions of the Laplace equation is to take a wire and bend it so 
that it corresponds to the graph of the temperature above the boundary of your region. Cut a rubber 
sheet in the shape of your region — a square in our case — and stretch it fixing the edges of the sheet 
to the wire. The rubber sheet is a good approximation of the graph of the solution to the Laplace 
equation with the given boundary data. 

4.9.1 Exercises 

Exercise 4.9.1; Let R be the region described byO<x<n and <y < n. Solve the problem 

Am = 0, 0) = sinjc, u{x,7t) = 0, u(0,y) = 0, u{7T,y) = 0. 

Exercise 4.9.2; Let R be the region described byO<x<l and < >' < 1. Solve the problem 

UxX + Uyy = 0, 

u{x,Qi) = sin(;r;c) - sin(2;rx), u{x, 1) = 0, 
m(0,3;) = 0, u{l,y) = 0. 

Exercise 4.9.3; Let R be the region described byQ<x<\ and Q <y < 1. Solve the problem 

UxX + Uyy = 0, 

u{x,Q) = u{x, 1) = u(S),y) = u(\,y) = C. 
for some constant C. Hint: Guess, then check your intuition. 
Exercise 4.9.4; Let R be the region described by < x < n and <y < n. Solve 
Au = 0, u{x,0) = 0, u(x,n) = n, u(0,y) = y, u(n,y)=y. 
Hint: Try a solution of the form u(x,y) = X(x) + Y(y) (different separation of variables). 
Exercise 4.9.5; Use the solution of Exercise 4.9.4 to solve 

Au = 0, u(x, 0) = sin x, u(x, n) = n, u(0, y) = y, u{n, y) = y. 
Hint: Use superposition. 

Exercise 4.9.6; Let R be the region described byO<x<w and < y < h. Solve the problem 

UxX + Uyy = 0, 

u{x, 0) = 0, u{x, h) = f{x), 
u(0,y) = 0, u{w,y) = 0. 

The solution should be in series form using the Fourier series coefficients of f{x). 
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Exercise 4.9.7; Let R be the region described byQ<x<w and <y < h. Solve the problem 

u(x, 0) = 0, u(x, h) = 0, 
u(0,y) = f(y), u(w,y) = 0. 

The solution should be in series form using the Fourier series coefficients off(y). 

Exercise 4.9.8; Let R be the region described byO<x<w and <y < h. Solve the problem 

u(x, 0) = 0, u(x, h) = 0, 
u(0,y) = 0, u(w,y) = f(y). 

The solution should be in series form using the Fourier series coefficients of f{y). 

Exercise 4.9.9; LetR be the region described byQ<x< 1 and Q <y < 1. Solve the problem 

^xx ^yy — 0> 

u(x, 0) = sin(97rx), u(x, 1) = sin(2;rx), 
u(0,y) = 0, u(l,y) = 0. 

Hint: Use superposition. 

Exercise 4.9.10; Let R be the region described by < x < I and <y < I. Solve the problem 

UxX "I" Uyy 0, 

u(x, 0) = sin(7rx), u(x, 1) = sin(;rx), 
u(0,y) = sin(;ry), u(l,y) = sin(;ry). 

Hint: Use superposition. 

Exercise 4.9.11 (challenging); Using only your intuition find u{^/2, 1/2), for the problem Au = 0, 
where u{0,y) = u(l,y) = 100 for < 3; < 1, and u(x,0) = u(x, 1) = 0/orO < x < I. Explain. 

Exercise 4.9.101; Let R be the region described by0<x<l and < y < 1. Solve the problem 




Exercise 4.9.102; Let R be the region described by < x < I and <y < 2. Solve the problem 
Am = 0, u{x, 0) = 0.1 sin(7rx), u{x, 2) = 0, u{0,y) = 0, u(l,y) = 0. 



220 



CHAPTER 4. FOURIER SERIES AND PDES 



4.10 Dirichlet problem in the circle and the Poisson kernel 

Note: 2 lectures, , §9.7 in [EP], §10.8 in [BDJ 



4.10.1 Laplace in polar coordinates 

A more natural setting for the Laplace equation Aw = is the circle rather than the square. On the 
other hand, what makes the problem somewhat more difficult is that we need polar coordinates. 
Recall that the polar coordinates for the (x,j)-plane are (r, 9): 

X = rcos 9, y = rsm9, 

where r > and -n < 9 < n. 

Now that we know our coordinates, let us give the problem we wish to 
solve. We have a circular region of radius 1, and we are interested in the 
Dirichlet problem for the Laplace equation for this region. Let u{r, 6) denote the temperature at the 
point (r, 9) in polar coordinates. We have the problem: 




(4.25) 



u{\,9)=g{9) 




Am = 0, for r < 1 , 

u{l,9)=g{9), for: -n<9<n. 

The first issue we face is that we do not know what the 
Laplacian is in polar coordinates. Normally we would find 
Uxx and Uyy in terms of the derivatives in r and 9. We would 
need to solve for r and 9 in terms of x and y. While this 
is certainly possible, it happens to be more convenient to 
work in reverse. Let us instead compute derivatives in r 
and 9 in terms of derivatives in x and y and then solve. The 
computations are easier this way. First 

Xr = cos 9, xe = -r sin 9, y,- = sin 9, ye = r cos 9. 

Next by chain rule we obtain 

Ur = U^Xr + Uyyr = cos(9)Ux + sm(9)Uy, 

Urr = C0S(9)(UxxXr + U^y^r) + Sm{9)(UyxXr + Uyy.yr) = C0%^{9)Uxx + 2 COS{9) Sm{9)Uxy + siVL'ifPjUyy. 

Similarly for the 9 derivative. Note that we have to use product rule for the second derivative. 

U0 = UxXe + Uyye = -rsm(9)Ujf + rcos(9)Uy, 

uee = -rcos(9)Ux - r sin{9){UxxX0 + Uxyye) - rsm{9)Uy + r cos(9)(UyxX0 + Uyyyg) 



= -r cos(9)Ux - r ^m{9)Uy + sir^{9)Uxx - sin(0) co^{9)Uxy + cos^(9)u 



yy. 
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Let us now try to solve for Uxx + % • We start with ^ugg to get rid of those pesky r^. If we add Urr 
and use the fact that cos^(9) + sin^(^) = 1, we get 

1 1 1 

-^Ue0 + Urr = Uxx + Uyy cos{d)Ux sm{6)Uy. 

We're not quite there yet, but all we are lacking is ^Ur. Adding it we obtain the Laplacian in polar 
coordinates: 

— Ugg + —Ur + Mrr ~ Uxx Uyy — AM. 

H r 

Notice that the Laplacian in polar coordinates no longer has constant coefficients. 



4.10.2 Series solution 

Let us separate variables as usual. That is let us try u(r, 6) = R{r)@{6). Then 

= Am = \r@" + -R'(d + ^"0. 
Let us put R on one side and on the other and then conclude that both sides must be constant. 

^ R&' = -\-R' +R"\@. 



0" _ _rR' + r^R" _ _^ 
~® ~ R 



We get two equations: 



0" + ^0 = 0, 

r^R" + rR' -AR = 0. 

Let us first focus on 0. We know that u(r, 0) ought to be 2;7r-periodic in 6, that is, u{r, 0) = u{r,6 + 2n). 
Therefore, the solution to 0" + /10 = must be 27r-periodic. We conclude that A = for a 

nonnegative integer n = 0, 1,2, 3, The equation becomes 0" + n^Q = 0. When n = the 

equation is just 0" = 0, so we have the general solution AO + B. As is periodic, A = 0. For 
convenience let us write this solution as 

00 = y 

for some constant aq- For positive n, the solution to 0" + n^& = is 

0„ = a„ cos(n^) + bn sm(nff). 



for some constants a„ and bn. 
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Next, we consider the equation for R, 

r^R" + rR' - n^R = 0. 

This equation has appeared in exercises before — we solved it in Exercise 2.1.6 and Exercise 2.1.7 
on page 50. The idea is to try a solution r' and if that does not work out try a solution of the form 
r ' In r. When n = we obtain 

Ro =Ar^ + Br^\nr = A + B\nr, 

and if n > 0, we get 

Rn = Ar" + Br". 

The function u{r, 6) must be finite at the origin, that is, when r = 0. Therefore, 5 = in both cases. 
Let us set A = 1 in both cases as well, the constants in 0„ will pick up the slack so we do not lose 
anything. Therefore let 

Ro = 1, and Rn = r". 
Hence our building block solutions are 

.o(r,e) = f, «„(r,e) = ay'cos(n^) + V"sin(n^). 

Putting everything together our solution is: 



2 n-. 



We look at the boundary condition in (4.25) 



u{r, 6) = ^ + '^anr" cos(n6) + b^r" sm(n6). 



g{6) = u{\,6) = — + y Qn cos{n6) + bn sin{n6). 



n=\ 



Therefore, the solution to (4.25) is to expand g{6), which is a 27r-periodic function as a Fourier 
series, and then the coordinate is multiplied by r". In other words, to compute a,, and bn from 
the formula we can, as usual, compute 



\ r \ r 

= - 8(0) cos(n6) do, and bn = - 



giO) sininO) dO. 



Example 4.10.1: Suppose we wish to solve 



Am = 0, 0<r<l, -n < 6 < n, 
M(l,e) = cos(lO0), -n<e<n. 
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The solution is 

u(r,e) = /°cos(lO0). 

See the plot in Figure 4.23. The thing to notice in this example is that the effect of a high 
frequency is mostly felt at the boundary. In the middle of the disc, the solution is very close to zero. 
That is because r^" becomes very small as r tends to 0. 

Example 4.10.2: Let us solve a more difficult problem. Suppose we have a long rod with circular 
cross section of radius 1 and we wish to solve the steady state heat problem. If the rod is long 
enough we simply need to solve the Laplace equation in two dimensions. Let us put the center of 
the rod at the origin and we have exactly the region we are currently studying — a circle of radius 1 . 
For the boundary conditions, suppose in Cartesian coordinates x and y, the temperature is fixed at 
when y < and at 2y when y > 0. 

We set the problem up. Asy = r sm(9), then on the circle of radius 1 we have 2y = 2 sm(6). So 

Am = 0, < r < 1, -n <e<n, 
f2sin(0) ifO<0<;r, 



u(l,e) = 



if -;r < 6* < 0. 
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We must now compute the Fourier series for the boundary condition. By now the reader has 
plentiful experience in computing Fourier series and so we simply state that 

2 ^ _4 

u(l,e) = - + sin(e) + y cos(2ne). 
n ^ n(4n^ - 1) 

n=l 

Exercise 4.10.1; Compute the series for u(l,6) and verify that it really is what we have just claimed. 
Hint: Be careful, make sure not to divide by zero. 



We now simply write the solution (see Figure 4.24) by multiplying by r" in the right places. 

2 . ^ -4r2" 



u{r, 6) = - + r sin(0) + V - 



^ n(4n^ - 1) 



cos{2n0). 



0.5 , 




r " [ u(r,theta) 
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Figure 4.24: The solution of the Dirichlet problem with boundary data for y < and 2y for y > 0. 
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4.10.3 Poisson kernel 



There is another way to solve the Dirichlet problem with the help of an integral kernel. That is, we 
will find a function P(r, 6, a) called the Poisson kernel* such that 



1 r 



P{r, 9, a) g(a) da. 



While the integral will generally not be solvable analytically, it can be evaluated numerically. In fact, 
unless the boundary data is given as a Fourier series already, it will be much easier to numerically 
evaluate this formula as there is only one integral to evaluate. 

The formula also has theoretical applications. For instance, as P(r, 6, a) will have infinitely 
many derivatives, then via differentiating under the integral we find that the solution u(r, 6) has 
infinitely many derivatives, at least when inside the circle, r < 1. By infinitely many derivatives 
what you should think of is that u(r, 6) has "no corners" and all of its partial derivatives too exist 
and have "no corners". 

We will compute the formula for P(r, 6, a) from the series solution, and this idea can be applied 
anytime you have a convenient series solution where the coefficients are obtained via integration. 
Hence you can apply this reasoning to obtain such integral kernels for other equations, such as the 
heat equation. The computation is long and tedious, but not overly difficult. Since the ideas are 
often applied in similar contexts, it is good to understand how this computation works. 

What we do is start with the series solution and replace the coefficients with the integrals that 
compute them. Then we try to write everything as a single integral. We must use a different dummy 
variable for the integration and hence we use a instead of 6. 

CO 



u(r, ^) = y + ^ ^'i''" cos(n0) + bnr" sm{n9) 



n=\ 



1 r 

^ 2n J ^^"^ 

+ ^(a)cos(nQ;) Jajr"cos(n0) + |- J" ^(a) sin(nQr) Jaj r" sin(n0) 

= I Si^t) + 2} g{a) cos(na)r" cos(n6) + g(a) sin(nQ')r" sin(n0) 

-'-'^ V n=l 



'\cos{na) cos{n6) + sm{na) sm(n6)) 



gia) da 



OK, so we have what we wanted, the expression in the parentheses is the Poisson kernel, P{r, 6, a). 
However, we can do a lot better. It is still given as a series, and we would really like to have a nice 



*Named for the French mathematician Simeon Denis Poisson (1781 - 1840). 
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simple expression for it. We must work a little harder. The trick is to rewrite everj^hing in terms of 
complex exponentials. Let us work just on the kernel. 

CO 

P(r, 9,a) = 1 + 2 ^ r"(cos(nQ;) cos(n6) + sin(nQr) sin(n^)) 
«=i 

CO 

n=l 

CO 

n=\ 

DO OO 



n=l 



n=\ 



In the above expression we recognize the geometric series. That is, recall from calculus that as long 
as |z| < 1, then 

OO 

z 

■ z 



n=\ 



Note that n starts at 1 and that is why we have the z in the numerator. It is the standard geometric 
series multiplied by z. Let us continue with the computation. 



P(r, e,a) = \ + Yj ire'^'~"^)" + J] {re-'^'-"^f 



n=l 



= 1 + 



re" 



+ 



n=l 

re~ 



(^{ — rg'(^~"^)(l — re"'(^""^) + (1 - re^''-^^"^)re''-^^"^ + (1 ~ )-e'''^~"^)re~'^^~"^ 



(1 _ re'^o-a)-^(^i _ re-ne-'^)) 



l-r^ 



I — fgi(e-a) _ fg-i(e-a) + ^2 

1-r^ 
1 - 2rcos(0- or) + r^' 



Now that's a forumla we can live with. The solution to the Dirichlet problem using the Poisson 
kernel is 



I r 1 - r2 

u(r, 0) = — \ - — — g(a) da. 

2?r j-n 1 - 2r cos(0 - or) + H 



Sometimes the formula for the Poisson kernel is given together with the constant ^, in which case 
we should of course not leave it in front of the integral. Also, often the limits of the integral are 
given as to 2n; everything inside is 2;r-periodic in a, so this does not change the integral. 
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Let us not leave the Poisson kernel without explaining its geometric meaning. Let s be the 
distance from (r, 6) to (\,a). You may recall from calculus that this distance s in polar coordinates 
is given precisely by the square root of 1 - 2r cos(0 - a) + r^. That is, the Poisson kernel is really 
the formula 



One final note we make about the formula is to note that it 
is really a weighted average of the boundary values. First let us 
look at what happens at the origin, that is when r = 0. 



m(0, 0) 



1 r 



1-02 



2(O)cos(0-Qr) + O2 

1 r 

= T- g(a) da. 
2?r J-n 



g(a) da 



(ha) 




So m(0, 0) is precisely the average value of g(6) and therefore the 
average value of u on the boundary. This is a general feature 
of harmonic functions, the value at some point p is equal to the 
average of the values on a circle centered at p. 

What the formula says is that the value of the solution at any point in the circle is a weighted 
average of the boundary data g(9). The kernel is bigger when (r, 6) is closer to (I, a). Therefore 
when computing u(r, 6) we give more weight to the values g{a) when (1, or) is closer to (r, 0) and 
less weight to the values g{a) when (1, a) far from (r, 6). 



4.10.4 Exercises 

Exercise 4.10.2; Using series solve Am = 0, m(1, 0) = \9\,for -n < 6 < n. 

Exercise 4.10.3; Using series solve Au = 0, u(l,6) = g(9) for the following data. Hint: trig 

identities. 

a) g(e) = 1/2 + 3 sin(0) + cos(3e) b) g(e) = 3 cos(30) + 3 sin(30) + sin(96') 

c) g(e) = 2 cos(e +1) d) g(e) = sm^(e) 

Exercise 4.10.4; Using the Poisson kernel, give the solution to Au = 0, where u{l,6) is zero for 9 
outside the interval [-V4, V4] <^nd u(l,6) is 1 for 9 on the interval [-V4, "h\. 

Exercise 4.10.5; a) Draw a graph for the Poisson kernel as a function of a when r = 1/2 and 9 = 0. 
b) Describe what happens to the graph when you make r bigger (as it approaches 1). c) Knowing 
that the solution u(r, 9) is the weighted average ofg{9) with Poisson kernel as the weight, explain 
what your answer to part b means. 

Exercise 4.10.6; Take the function g{9) to be the function xy = cos 9 sin 9 on the boundary. Use the 

series solution to find a solution to the Dirichlet problem Au = 0, u(l,9) = g{9). Now convert the 
solution to Cartesian coordinates x andy. Is this solution surprising? Hint: use your trig identities. 
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Exercise 4.10.7; Carry out the computation we needed in the separation of variables and solve 
r^R" + rR' - n^R = 0, for n = 0,1,2,3, .. .. 

Exercise 4.10.8 (challenging); Derive the series solution to the Dirichlet problem if the region is a 
circle of radius p rather than 1. That is, solve Au = 0, u(p, 6) = g(6). 

Exercise 4.10.101; Using series solve Au = 0, u(l,6) = I + 2^=i sm(nd). 

Exercise 4.10.102; Using the series solution find the solution to Au = 0, u(l,6) = 1 - cos(9). 
Express the solution in Cartesian coordinates (that is, using x andy). 

Exercise 4.10.103; a) Try and guess a solution to Au - -I, u{l,6) = 0. Hint: try a solution that 
only depends on r. Also first, don't worry about the boundary condition, b) Now solve Au = -1, 
u(l,9) = sin(20) using superposition. 

Exercise 4.10.104 (challenging); Derive the Poisson kernel solution if the region is a circle of 
radius p rather than 1. That is, solve Au = 0, u(p, 9) = g{9). 



Chapter 5 



Eigenvalue problems 

5.1 Sturm-Liouville problems 

Note: 2 lectures, §10.1 in [EPJ, §11.2 in [BD] 

5.1.1 Boundary value problems 

We have encountered several different eigenvalue problems such as: 

X"ix) + AXix) = 

with different boundary conditions 

X(0) = X{L) = (Dirichlet) or, 

X'(0) = X'(L) = (Neumann) or, 

X'(0) = X(L) = (Mixed) or, 

X(0) = X'(L) = (Mixed), . . . 

For example for the insulated wire, Dirichlet conditions correspond to applying a zero temperature 

at the ends, Neumann means insulating the ends, etc Other types of endpoint conditions also 

arise naturally, such as the Robin boundary conditions 

hX(0) - X'(0) = hX(L) + X'{L) = 0, 

for some constant h. These conditions come up when the ends are immersed in some medium. 

Boundary problems came up in the study of the heat equation Ut = kuxx when we were trying to 
solve the equation by the method of separation of variables. In the computation we encountered a 
certain eigenvalue problem and found the eigenf unctions X„{x). We then found the eigenfunction 
decomposition of the initial temperature f(x) = u{x, 0) in terms of the eigenfunctions 

DO 

fix) = ^CnXn(x). 

11=1 
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Once we had this decomposition and found suitable Tn(t) such that T„{0) = 1 and T„(t)X(x) were 
solutions, the solution to the original problem including the initial condition could be written as 



i(x,t) = Y[^CnTn(t)X„{x). 



We will try to solve more general problems using this method. First, we will study second order 
linear equations of the form 



d_ 
dx 



dy 

P^^^Yx ' ~ ^^^^^ ^ Ar(x)y = 0. 



(5.1) 



Essentially any second order linear equation of the form a(x)y" + b(x)y' + c(x)y + Ad{x)y = can 
be written as (5.1) after multiplying by a proper factor. 

Example 5.1.1 (Bessel): Put the following equation into the form (5.1) : 

xY + xy' + (Ax'-n')y = 0. 

Multiply both sides by ^ to obtain 

1 / 2 » ^ ' ^ / 1 2 2\ \ " ^ ' ^( , d I dy\ ^2 

-[x y + xy + I Ax - n jyj = xy +y +\Ax ■^'T' ) y ^-^-^ ~ ^- 

X \ X J dx \ dx j X 

The so-called Sturm-Liouville problem* is to seek nontrivial solutions to 



d_ 

dx 



p{x) 



dy 
dx 



q{x)y + Ar{x)y = 0, a < x <b. 



aiy{a) - ajyXa) = 0, 
Mb)+/32y'{b) = 0. 



(5.2) 



In particular, we seek As that allow for nontrivial solutions. The As that admit nontrivial solutions 
are called the eigenvalues and the corresponding nontrivial solutions are called eigenfunctions. The 
constants a\ and ai should not be both zero, same for /3i and ^2- 

Theorem 5.1.1. Suppose p(x), p'(x), q{x) and r{x) are continuous on [a, b] and suppose p(x) > 
and r(x) > Ofor all x in [a,b]. Then the Sturm-Liouville problem (5.2) has an increasing sequence 
of eigenvalues 

Ai < A2 < A-i < ■ ■ ■ 

such that 

lim An = +00 

»oo 

and such that to each An there is (up to a constant multiple) a single eigenfunction yn{x). 
Moreover, ifq(x) > and ai, 02,^1,^2 ^ 0, then An > Ofor all n. 



*Named after the French mathematicians Jacques Charles Fran9ois Sturm (1803 - 1855) and Joseph Liouville 
(1809- 1882). 
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Problems satisfying the hypothesis of the theorem are called regular Sturm-Liouville problems 
and we will only consider such problems here. That is, a regular problem is one where p{x), p'(x), 
q{x) and r{x) are continuous, p{x) > 0, r{x) > 0, q{x) > 0, and a\,a2,lii,p2 > 0. Note: Be careful 
about the signs. Also be careful about the inequalities for r and p, they must be strict for all x\ 

When zero is an eigenvalue, we usually start labeling the eigenvalues at rather than 1 for 
convenience. 

Example 5.1.2: The problem y" + Ay, < x < L, y{Qi) = 0, and y{L) = is a regular Sturm- 
Liouville problem. p{x) = 1, q{x) = 0, r(x) = 1, and we have p{x) = 1 > and r(x) = 1 > 0. The 

2 2 

eigenvalues are /l„ = ^ and eigenfunctions are yn(x) = sin(Y^x). All eigenvalues are nonnegative 
as predicted by the theorem. 

Exercise 5.1.1; Find eigenvalues and eigenfunctions for 



Identify the p, q, r, aj,/3j. Can you use the theorem to make the search for eigenvalues easier? (Hint: 
Consider the condition -y'iO) = 0) 

Example 5.1.3: Find eigenvalues and eigenfunctions of the problem 

y" + Ay = 0, 0<x<l, 

hy(0) - y'iO) = 0, /(I) = 0, h>0. 

These equations give a regular Sturm-Liouville problem. 

Exercise 5.1.2; Identify p, q, r, aj,fij in the example above. 

First note that /I > by Theorem 5.1.1. Therefore, the general solution (without boundary 
conditions) is 



Let us see if /I = is an eigenvalue: We must satisfy = hB - A and A = 0, hence 5 = (as 
h > 0), therefore, is not an eigenvalue (no nonzero solution, so no eigenf unction). 
Now let us try /I > 0. We plug in the boundary conditions. 



If A = 0, then 5 = and vice-versa, hence both are nonzero. So B = and = -A sin(V^) -l- 
cos(V^). As A ?t we get 



y"+Ay = 0, /(0) = 0, /(I) = 0. 



yix) = A cosi^^A x) + B sin( x) 
y{x) =Ax + B 



if /I > 0, 
ifA = 0. 



= M - yfAB, 

= -A sin(V^) + ByfA cos(V^). 



= - sin(V^) + /zcos(V^), 
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or 

— = tan yA. 

Now use a computer to find A„. There are tables available, though using a computer or a graphing 
calculator is far more convenient nowadays. Easiest method is to plot the functions and tanx 
and see for which x they intersect. There is an infinite number of intersections. Denote by 

the first intersection, by ^/A^ the second intersection, etc For example, when /z = 1, we get 

that « 0.86, « 3.43, .... That is Ai ^ 0.74, A2 « 11.73, .... A plot for /z = 1 is given in 
Figure 5.1. The appropriate eigenf unction (let A = 1 for convenience, then B = VVI) is 

^ ^ /— 
yn{x) = cos(^JAnX) H — — sm(^JA„x). 

^^An 



When /i = 1 we get (approximately) 



yi{x) ~ cos(0.86 x) + — — sin(0.86 x), y2{x) ~ cos(3.43 x) + — - sin(3.43 x). 




5.1.2 Orthogonality 

We have seen the notion of orthogonality before. For example, we have shown that sin(Rx) are 
orthogonal for distinct n on [0, tt]. For general Sturm-Liouville problems we will need a more 
general setup. Let r{x) be a weight function (any function, though generally we will assume it is 
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positive) on [a, b]. Two functions f(x), g(x) are said to be orthogonal with respect to the weight 
function r(x) when 

fix) gix) rix) dx = 0. 



J 



In this setting, we define the inner product as 

, rh 

(/' g) =' I /(^) .?(^) rix) dx, 

J a 

and then say / and g are orthogonal whenever </, = 0. The results and concepts are again 
analogous to finite dimensional linear algebra. 

The idea of the given inner product is that those x where rix) is greater have more weight. 
Nontrivial (nonconstant) rix) arise naturally, for example from a change of variables. Hence, you 
could think of a change of variables such that d^ = rix) dx. 

We have the following orthogonality property of eigenfunctions of a regular Sturm-Liouville 
problem. 

Theorem 5.1.2. Suppose we have a regular Sturm-Liouville problem 

d I dy\ 

— \pix)— - qix)y + Arix)y = 0, 



dx\ dxj 
aiyia) - a2y'ia) = 0, 
/3,yib)+/32y'ib) = 0. 

Letyj andyk be two distinct eigenfunctions for two distinct eigenvalues Aj and A^. Then 



yjix)ykix) rix) dx = 0, 



that is, yj and yt are orthogonal with respect to the weight function r. 

Proof is very similar to the analogous theorem from §4.1. It can also be found in many books 
including, for example, Edwards and Penney [EP]. 

5.1.3 Fredholm alternative 

We also have the Fredholm alternative theorem we talked about before for all regular Sturm- 
Liouville problems. We state it here for completeness. 

Theorem 5.1.3 (Fredholm alternative). Suppose that we have a regular Sturm-Liouville problem. 
Then either 

d I dy\ 

-r p(x)-r - <i(x)y + Mx)y = 0, 



dx \ dx 
aiyia) - a2y'ia) = 0, 
fiiyib)+/32y'ib) = 0. 
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d I dy\ 

P(x)— - q{x)y + Ar{x)y = f(x), 



has a nonzero solution, or 



dx \ dx 
aiy(a) - ajy'ia) = 0, 
Mb)+/32y'{b) = 0, 

has a unique solution for any f(x) continuous on [a, b]. 

This theorem is used in much the same way as we did before in § 4.4. It is used when solving 
more general nonhomogeneous boundary value problems. The theorem does not help us solve 
the problem, but it tells us when a unique solution exists, so that we know when to spend time 
looking it. To solve the problem we decompose f{x) and y(x) in terms of the eigenfunctions of the 
homogeneous problem, and then solve for the coefficients of the series for y{x). 



5.1.4 Eigenfunction series 

What we want to do with the eigenfunctions once we have them is to compute the eigenfunction 
decomposition of an arbitrary function f{x). That is, we wish to write 



f{x) = ^ c„yn{x). 



(5.3) 



n=l 



where the eigenfunctions. We wish to find out if we can represent any function f{x) in this way, 
and if so, we wish to calculate c„ (and of course we would want to know if the sum converges). OK, 
so imagine we could write f{x) as (5.3) . We will assume convergence and the ability to integrate 
the series term by term. Because of orthogonality we have 



Hence, 



{f,ym)= I f{x)y,„{x)r(x) dx 

J a 

= ^ c„ I yn{x) y,„{x) r(x) dx 

n=l ^« 



J a 



ym{x)y,n{x) r{x) dx = c„{y,„,ym). 



rh 

(f,ym) I f(x)ym(x)r(x)dx 

{ym(x)f r(x) dx 



{ym,ym) 



(5.4) 



Note that y^ are known up to a constant multiple, so we could have picked a scalar multiple 
of an eigenfunction such that {ym,ym) = 1 (if we had an arbitrary eigenfunction y^, divide it by 



5.1. STURM-LIOUVILLE PROBLEMS 



235 



■\J{ym,ym))- When {y,n,ym) = 1 we have the simpler form Cm = {f,ym) as we did for the Fourier 
series. The following theorem holds more generally, but the statement given is enough for our 
purposes. 

Theorem 5.1.4. Suppose f is a piecewise smooth continuous function on [a, b]. Ifyi,y2, . ■ ■ are the 
eigenf unctions of a regular Sturm-Liouville problem, then there exist real constants ci, C2, . . . given 
by (5.4) such that (5.3) converges and holds for a < x <b. 

Example 5.1.4: Take the simple Sturm-Liouville problem 

y" + Xy = 0, 0<x<'^, 

y(0) = 0, /(^) = o. 

The above is a regular problem and furthermore we actually know by Theorem 5.1.1 on page 230 
that A>Q. 

Suppose A = 0, then the general solution is y{x) = Ax + 5, we plug in the initial conditions 
to get = j(0) = B, and = y'(|)=A, hence /I = is not an eigenvalue. The general solution, 
therefore, is 

y{x) = Acos(Vix) + 5sin(VI;c). 
Plugging in the boundary conditions we get = y{0) = A and = /(f) = V^5cos(V^|). B 
cannot be zero and hence cos (VI I) = 0. This means that VI | must be an odd integral multiple of 
f , i.e. {2n - l)f = V^ f . Hence 

An = (2n - If. 
We can take 5=1. Hence our eigenfunctions are 

yn(x) = sin((2« - l)x). 

Finally we compute 

I (sin((2n - l)x)j dx = -. 
So any piecewise smooth function on [0, |] can be written as 

CO 

fix) = 2 c„ sin((2n - l)x), 

where 

(f,yn) _ lo f-^^ sin((2n - l)x) dx ^ 4 

^^"^"^ fj (Mi^n - l)x)f dx 

Note that the series converges to an odd 27r-periodic (not 7r-periodic!) extension of f(x). 

Exercise 5.1.3 (challenging); In the above example, the function is defined on < x < ^, yet the 
series converges to an odd In-periodic extension of f{x). Find out how is the extension defined for 
^ < X <n. 



I fix) sin((2n - l)x) dx. 
Jn 
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5.1.5 Exercises 

Exercise 5.1.4; Find eigenvalues and eigenfunctions of 

y" + Ay = 0, X0)-/(0) = 0, yiD = 0. 

Exercise 5.1.5; Expand the function f(x) = x onO < x < 1 using the eigenfunctions of the system 

y" + Ay = Q, /(O) = 0, jd) = 0. 

Exercise 5.1.6; Suppose that you had a Sturm-Liouville problem on the interval [0, 1] and came up 
with ynix) = sm(ynx), where y > is some constant. Decompose f{x) = x,Q < x < \ in terms of 
these eigenfunctions. 

Exercise 5.1.7; Find eigenvalues and eigenfunctions of 

y^'^ + Xy = Q, >'(0) = 0, /(O) = 0, y(l) = 0, /(I) = 0. 
This problem is not a Sturm-Liouville problem, but the idea is the same. 
Exercise 5.1.8 (more challenging); Find eigenvalues and eigenfunctions for 

^(ey) + Ae'^y = 0, y(0) = 0, y(l) = 0. 
dx 

Hint: First write the system as a constant coefficient system to find general solutions. Do note that 
Theorem 5. LI on page 230 guarantees A>0. 

Exercise 5.1.101; Find eigenvalues and eigenfunctions of 

y" + Ay = 0, 3;(-l) = 0, yiD = 0. 

Exercise 5.1.102; Put the following problems into the standard form for Sturm-Liouville problems, 
that is, find p{x), q{x), r{x), a^, aj, fii, and jSi, and decide if the problems are regular or not. 

a) xy" + Ay = Ofor < x < I, y{0) = 0, y(l) = 0, 

b) (1 + x^)y" - Ixy' + - x^)y = 0/or -1 < ;c < 1, ^(-1) = 0, y{\) + /(I) = 0. 
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5.2 Application of eigenfunction series 

Note: 1 lecture, §10.2 in [EP], exercises in §11.2 in [BD] 

The eigenfunction series can arise even from higher order equations. Suppose we have an elastic 
beam (say made of steel). We will study the transversal vibrations of the beam. That is, assume the 
beam lies along the x axis and let y(x, t) measure the displacement of the point x on the beam at 
time t. See Figure 5.2. 

y k 




Figure 5.2: Transversal vibrations of a beam. 



The equation that governs this setup is 

t 

dx^ ' dt^ 



d'^y 

a —— + -— = 0, 



for some constant a > 0. 

Suppose the beam is of length 1 simply supported (hinged) at the ends. The beam is displaced 
by some function f{x) at time ? = and then let go (initial velocity is 0). Then y satisfies: 

a^yxxxx + Jtt = {0<x<l,t>0), 

y{l,t) = y,Al,t) = 0, 
y(x,0) = f(x), y,(x,0) = 0. 

Again we try y(x, t) = X{x)T{t) and plug in to get d^X^'^^T + XT" = or 



X a^T 



We note that we want T" + Aa^T = 0. Let us assume that A > 0. We can argue that we expect 
vibration and not exponential growth nor decay in the t direction (there is no friction in our model 
for instance). Similarly A = will not occur. 



Exercise 5.2.1; Try to justify A > just from the equations. 
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Write co'^ = A, so that we do not need to write the fourth root all the time. For X we get the 
equation X^'^^ - a/X = 0. The general solution is 

X{x) = Ae'^' + Be''^'' + C sin(i^x) + Dco^{o)x). 

Now = X(0) =A + B + D,Q = X"(0) = a)\A + B - D). Hence, D = and A + 5 = 0, or 5 = -A. 
So we have 

X{x) = Ae'^-' - Ae"'^-' + C %m{cox). 

Also = X{\) = A(e^ - e"^) + C sin a;, and = X"{1) = Ao/{e'^ - e"^) - Coj^ sinw. This means 
that C sin (t; = and A(e'^ - e~'^) = 2A sinh cj = 0. \i oj > Q, then sinh ct; ?t and so A = 0. This 
means that C otherwise A is not an eigenvalue. Also oj must be an integer multiple of n. Hence 
<jj = nn and « > 1 (as a» > 0). We can take C = 1. So the eigenvalues are An = n^n^ and the 
eigenf unctions are ^m{nnx). 

Now T" + n'^n^a'^T = 0. The general solution is Tit) = AsinCnVa^O + Bcos(n^n^a^t). But 
r'(0) = and hence we must have A = and we can take 5 = 1 to make r(0) = 1 for convenience. 
So our solutions are T^it) = cos(n^n^a^t). 

As the eigenfunctions are just sines again, we can decompose the function f(x) on < x < 1 
using the sine series. We find numbers b„ such that for < x < 1 we have 

oo 

fix) = Y^bn ?,in{nnx). 

11=1 

Then the solution to (5.5) is 

oo oo 

y{x, = ^ b„Xn{x)Tn{t) = ^ bn sin(n;r.x:) cos(n^n^a^t). 



n=\ n=\ 



The point is that X„r„ is a solution that satisfies all the homogeneous conditions (that is, all 
conditions except the initial position). And since and r„(0) = 1, we have 

CO oo oo 

y{x, 0) = 2 bnX„{x)Tn{0) = ^ bnXn(x) = ^ bn sin(n;r.^) = f(x). 

n=l n=l n=l 

So y(x, t) solves (5.5) . 

The natural (circular) frequencies of the system are n^np-a^. These frequencies are all integer 
multiples of the fundamental frequency n^a^, so we get a nice musical note. The exact frequencies 
and their amplitude are what we call the timbre of the note. 

The timbre of a beam is different than for a vibrating string where we get "more" of the lower 

frequencies since we get all integer multiples, 1, 2, 3, 4, 5, For a steel beam we get only the 

square multiples 1,4, 9, 16, 25, That is why when you hit a steel beam you hear a very pure 

sound. The sound of a xylophone or vibraphone is, therefore, very different from a guitar or piano. 
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Example 5.2.1: Let us assume that f(x) = . On < jc < 1 we have (you know how to do this 
by now) 



5.2.1 Exercises 

Exercise 5.2.2; Suppose you have a beam of length 5 with free ends. Let y be the transverse 
deviation of the beam at position x on the beam (Q < x < 5). You know that the constants are such 
that this satisfies the equation y,t + Ayxxxx = 0. Suppose you know that the initial shape of the beam 
is the graph of x(5 — x), and the initial velocity is uniformly equal to 2 (same for each x) in the 
positive y direction. Set up the equation together with the boundary and initial conditions. Just set 
up, do not solve. 

Exercise 5.2.3; Suppose you have a beam of length 5 with one end free and one end fixed (the 
fixed end is at x = 5). Let u be the longitudinal deviation of the beam at position x on the beam 
(0 < X < 5). You know that the constants are such that this satisfies the equation Uu = ^Uxx- Suppose 
you know that the initial displacement of the beam is and the initial velocity is -^f^ in the 
positive u direction. Set up the equation together with the boundary and initial conditions. Just set 
up, do not solve. 

Exercise 5.2.4; Suppose the beam is L units long, everything else kept the same as in (5.5) . What 
is the equation and the series solution ? 

Exercise 5.2.5; Suppose you have 



That is, you have also an initial velocity. Find a series solution. Hint: Use the same idea as we did 
for the wave equation. 

Exercise 5.2.101; Suppose you have a beam of length 1 with hinged ends. Lety be the transverse 
deviation of the beam at position x on the beam (Q < x < I). You know that the constants are such 
that this satisfies the equation y^ + ^yxxxx = 0. Suppose you know that the initial shape of the beam 
is the graph ofsm(nx), and the initial velocity is 0. Solve for y. 




Hence, the solution to (5.5) with the given initial position f(x) is 




n=l 
n odd 



a^yxxxx + y« = (0 < X < 1, f > 0), 

y{Q,t) = yxx{Q,t) = Q, 

y{l,t) = yxx{l,t) = 0, 

y{x,0) = f(x\ yr(x,0) = g(x). 
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Exercise 5.2.102; Suppose you have a beam of length 10 with two fixed ends. Let y be the transverse 
deviation of the beam at position x on the beam (Q < x < lOj. You know that the constants are such 
that this satisfies the equation y^ + ^yxxxx = 0- Suppose you know that the initial shape of the beam 
is the graph o/sm(7rx), and the initial velocity is uniformly equal to x(lO - x). Set up the equation 
together with the boundary and initial conditions. Just set up, do not solve. 
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5.3 Steady periodic solutions 

Note: 1-2 lectures, §10.3 in [EPJ, not in [BD] 
5.3.1 Forced vibrating string. 

Suppose that we have a guitar string of length L. We have studied the wave equation problem in this 
case, where x was the position on the string, t was time and y was the displacement of the string. 
See Figure 5.3. 



y 






^^^^ 







L X 



Figure 5.3: Vibrating string. 



The problem is governed by the equations 

ytt = a^yxx, 

y(0,0 = 0, y(L,t) = 0, (5.6) 
y(x,0) = f{x), yr(x,0) = g{x). 

We saw previously that the solution is of the form 

DO 

Z( (nna \ . (nna \\ . Inn \ 
yAn cos y— tj + Bn sm y— ?jj sm , 

n=l 

where A„ and 5„ were determined by the initial conditions. The natural frequencies of the system 
are the (circular) frequencies ^ for integers n > I. 

But these are free vibrations. What if there is an external force acting on the string. Let us 
assume say air vibrations (noise), for example a second string. Or perhaps a jet engine. For 
simplicity, assume nice pure sound and assume the force is uniform at every position on the string. 
Let us say F(t) = Fq cos(a)0 as force per unit mass. Then our wave equation becomes (remember 
force is mass times acceleration) 

ytt = a^yxx + Fo cos(ct»0, (5.7) 
with the same boundary conditions of course. 
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We want to find the solution here that satisfies the above equation and 

3;(0,0 = 0, yiL,t) = 0, yix,0) = 0, y,ix,0) = 0. 



(5.8) 



That is, the string is initially at rest. First we find a particular solution yp of (5.7) that satisfies 
y{0, t) = y{L, t) = 0. We define the functions / and g as 



fix) = -yp(x, 0), 



g{x) = -^(,x,0). 
ot 



We then find solution yc of (5.6) . If we add the two solutions, we find that y = yc + yp solves (5.7) 
with the initial conditions. 

Exercise 5.3.1; Check thaty = yc +yp solves (5.7) and the side conditions (5.8) . 

So the big issue here is to find the particular solution yp. We look at the equation and we make 
an educated guess 

yp(x, t) = X{x) cos{a)t). 

We plug in to get 

-w^Z cos(a»0 = a^X" cos(a»0 + Fq cos(ojt), 

or -oj^X = a^X" + Fq after canceling the cosine. We know how to find a general solution to this 
equation (it is a nonhomogeneous constant coefficient equation). The general solution is 



X{x) = A cos ^— + 5 sin 
The endpoint conditions imply X{Qi) = X(L) = 0. So 



CO 



Fo 
a?' 



or A = and also 



= X(0) = A 



= X(L) = ^cos(^^^) + 5sin(^) 



2' 



a 



Assuming that sin(^) is not zero we can solve for B to get 



B 



co^ sm 



Therefore, 



-Fo(cos(f)-l) 



cos 



a> 



(5.9) 
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The particular solution yp we are looking for is 



^0 

yp(x, t) = 



' (CO \ cos(^)- 1 /OJ \ ^ 

cos { — x] — - — sin — X 1 - 1 

« ' sin(^) ^« 



cos(ojt). 



Exercise 5.3.2; Check that yp works. 

Now we get to the point that we skipped. Suppose that sin(^) = 0. What this means is that oj is 
equal to one of the natural frequencies of the system, i.e. a multiple of We notice that if to is not 
equal to a multiple of the base frequency, but is very close, then the coefficient B in (5.9) seems 
to become very large. But let us not jump to conclusions just yet. When a» = ^ for n even, then 
cos(^) = 1 and hence we really get that 5 = 0. So resonance occurs only when both cos(^) = -1 
and sin(^) = 0. That is when co = '-^ for odd n. 

We could again solve for the resonance solution if we wanted to, but it is, in the right sense, the 
limit of the solutions as co gets close to a resonance frequency. In real life, pure resonance never 
occurs anyway. 

The above calculation explains why a string will begin to vibrate if the identical string is plucked 
close by. In the absence of friction this vibration would get louder and louder as time goes on. On 
the other hand, you are unlikely to get large vibration if the forcing frequency is not close to a 
resonance frequency even if you have a jet engine running close to the string. That is, the amplitude 
will not keep increasing unless you tune to just the right frequency. 

Similar resonance phenomena occur when you break a wine glass using human voice (yes this 
is possible, but not easy*) if you happen to hit just the right frequency. Remember a glass has much 
purer sound, i.e. it is more like a vibraphone, so there are far fewer resonance frequencies to hit. 

When the forcing function is more complicated, you decompose it in terms of the Fourier series 
and apply the above result. You may also need to solve the above problem if the forcing function is 
a sine rather than a cosine, but if you think about it, the solution is almost the same. 

Example 5.3.1: Let us do the computation for specific values. Suppose Fq = I and to = I and 
L = 1 and a = I. Then 

/ cos(l)-l \ 

yp(x, t) = cos(x) : sin(x) - 1 cos(0. 

\ sm(l) / 

Write B = ^fg^i for simphcity. 
Then plug in ? = to get 

f(x) = -yp(x, 0) = - cos X + Bsmx+ 1, 
and after differentiating in t we see that g(x) = -'^(x,0) = 0. 



*Mythbusters, episode 31, Discovery Channel, originally aired may 18th 2005. 
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Hence to find yc we need to solve the problem 

ytt — yxxi 

j(0,0 = 0, 3;(1,0 = 0, 
y{x, 0) = - cos X + 5 sin X + 1 , 
yr(^,0) = 0. 

Note that the formula that we use to define y{x, 0) is not odd, hence it is not a simple matter of 
plugging in to apply the D'Alembert formula directly! You must define F to be the odd, 2-periodic 
extension of y{x, 0). Then our solution would look like 




(5.10) 



Figure 5.4: Plot oiy{x, t) = ^(-'^+^)+^(^-^) + (cos(x) - ^fg^ sin(x) - l) cos(0. 



It is not hard to compute specific values for an odd extension of a function and hence (5.10) is a 
wonderful solution to the problem. For example it is very easy to have a computer do it, unlike a 
series solution. A plot is given in Figure 5.4. 
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5.3.2 Underground temperature oscillations 

Let u(x, t) be the temperature at a certain location at depth x underground at time t. See Figure 5.5. 



\ \ w 



depth X 



Figure 5.5: Underground temperature. 



The temperature u satisfies the heat equation Ut = ku^x, where k is the difFusivity of the soil. We 
know the temperature at the surface m(0, t) from weather records. Let us assume for simplicity that 

m(0, t) = Tq+ Aq COS{(x)t). 

For some yearly mean temperature To, then ? = is midsummer (you can put negative sign above 
to make it midwinter if you wish). Aq gives the typical variation for the year. That is, the hottest 
temperature is Tq + Aq and the coldest is Tq - Aq. For simplicity, we will assume that Tq = 0. The 
frequency to is picked depending on the units of t, such that when t = \ year, then ojt = In. 

It seems reasonable that the temperature at depth x will also oscillate with the same frequency. 
This, in fact, will be the steady periodic solution, independent of the initial conditions. So we are 
looking for a solution of the form 

u{x, t) = V{x) cos(ci>0 + W{x) sin((x)0- 

for the problem 

u, = kujcx, u(0,t) = Aocos(a)t). (5.11) 

We will employ the complex exponential here to make calculations simpler. Suppose we have a 
complex valued function 

Hx, t) = X{x) e''^'. 

We will look for an h such that Re = m. To find an h, whose real part satisfies (5.11) , we look for 
an h such that 

ht = kh,,, /z(0,0 =Aoe'"'. (5.12) 



Exercise 5.3.3; Suppose h satisfies (5.12) . Use Euler's formula for the complex exponential to 
check that u = Reh satisfies (5.11). 
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Substitute h into (5.12) . 

icoXe''^' = kX"e''^\ 

Hence, 

kX" - iojX = 0, 

or 

X" - a^X = 0, 

where a = ± Note that + V/ = +^ so you could simplify to a = +(1 + /) yf^. Hence the 
general solution is 

We assume that an X{x) that solves the problem must be bounded as x ^ oo since u(x, t) should 
be bounded (we are not worrying about the earth core!). If you use Euler's formula to expand the 
complex exponentials, you will note that the second term will be unbounded (if B 4^ 0), while the 
first term is always bounded. Hence 5 = 0. 

Exercise 5.3.4; Use Euler's formula to show that e*^'"^'^VS^ fg unbounded as x ^ oo, while 
VS -^ is bounded as x ^ co. 

Furthermore, X{0) = Aq since h(0, t) = A^e"^'. Thus A = Aq. This means that 

hix,t) = Aoe-^^^'^^^'e'"" = Aoe"^'^'^ VI^+'^' = Aq^" V¥-^e'(^'- V¥^). 
We will need to get the real part of h, so we apply Euler's formula to get 



h{x, t) = Aoe I cos {cot - -^j ^ x\ + ism {tot - -\l ^ x 

Then finally 




\ V 2k 




u(x, t) = Re h{x, t) = Aoe ^ 2* cos {cot - y ^ x 

Yay! 

Notice the phase is different at different depths. At depth x the phase is delayed by ^k- 
For example in cgs units (centimeters-grams-seconds) we have k = 0.005 (typical value for soil), 
CO = T^? = ^, « 1.99 X 10"^. Then if we compute where the phase shift jc^/^ = n 

seconds m a year 31,557,341 ^ ^ y 2k 

we find the depth in centimeters where the seasons are reversed. That is, we get the depth at which 
summer is the coldest and winter is the warmest. We get approximately 700 centimeters, which is 
approximately 23 feet below ground. 

Be careful not to jump to conclusions. The temperature swings decay rapidly as you dig deeper. 

The amplitude of the temperature swings is A^e'^^^ . This function decays very quickly as x (the 
depth) grows. Let us again take typical parameters as above. We will also assume that our surface 
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temperature swing is +15° Celsius, that is, Aq = 15. Then the maximum temperature variation at 
700 centimeters is only +0.66° Celsius. 

You need not dig very deep to get an effective "refrigerator," with nearly constant temperature. 
That is why wines are kept in a cellar; you need consistent temperature. The temperature differential 
could also be used for energy. A home could be heated or cooled by taking advantage of the above 
fact. Even without the earth core you could heat a home in the winter and cool it in the summer. The 
earth core makes the temperature higher the deeper you dig, although you need to dig somewhat 
deep to feel a difference. We did not take that into account above. 

5.3.3 Exercises 

Exercise 5.3.5; Suppose that the forcing function for the vibrating string is Fq sin(a)t). Derive the 
particular solution yp. 

Exercise 5.3.6; Take the forced vibrating string. Suppose that L = \, a = \. Suppose that the 
forcing function is the square wave that is 1 on the interval Q < x < \ and — \ on the interval 
- 1 < X <Q. Find the particular solution. Hint: You may want to use result of Exercise 5.3.5. 

Exercise 5.3.7; The units are cgs (centimeters-grams-seconds). Fork = 0.005, co = 1.991 x 10"^, 
Ao = 20. Find the depth at which the temperature variation is half (±10 degrees) of what it is on the 
surface. 

Exercise 5.3.8; Derive the solution for underground temperature oscillation without assuming that 
To = 0. 

Exercise 5.3.101; Take the forced vibrating string. Suppose that L = I, a = I. Suppose that 
the forcing function is a sawtooth, that is \x\ - ^ on -I < x < 1 extended periodically. Find the 
particular solution. 

Exercise 5.3.102; The units are cgs (centimeters-grams-seconds). Fork = 0.01, a> = 1.991 x 10"^, 
Ao = 25. Find the depth at which the summer is again the hottest point. 
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Chapter 6 



The Laplace transform 



6.1 The Laplace transform 

Note: 1.5 - 2 lectures, §10.1 in [EPJ, §6.1 and parts of §6.2 in [BP] 
6.1.1 The transform 

In this chapter we will discuss the Laplace transform* . The Laplace transform turns out to be a very 
efficient method to solve certain ODE problems. In particular, the transform can take a differential 
equation and turn it into an algebraic equation. If the algebraic equation can be solved, applying 
the inverse transform gives us our desired solution. The Laplace transform also has applications in 
the analysis of electrical circuits, NMR spectroscopy, signal processing, and elsewhere. Finally, 
understanding the Laplace transform will also help with understanding the related Fourier transform, 
which, however, requires more understanding of complex numbers. We will not cover the Fourier 
transform. 

The Laplace transform also gives a lot of insight into the nature of the equations we are dealing 
with. It can be seen as converting between the time and the frequency domain. For example, take 
the standard equation 

mx"(t) + cx'it) + kx(t) = f(t). 

We can think of t as time and f(t) as incoming signal. The Laplace transform will convert the 
equation from a differential equation in time to an algebraic (no derivatives) equation, where the 
new independent variable s is the frequency. 

We can think of the Laplace transform as a black box. It eats functions and spits out functions 
in a new variable. We write X{/(0} = for the Laplace transform of f{t). It is common to 
write lower case letters for functions in the time domain and upper case letters for functions in the 

*Just like the Laplace equation and the Laplacian, the Laplace transform is also named after Pierre-Simon, marquis 
de Laplace (1749 - 1827). 
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frequency domain. We use the same letter to denote that one function is the Laplace transform of 
the other. For example F{s) is the Laplace transform of f{t). Let us define the transform. 



£{f{t)} = F(s) 







e~''fit) dt. 



We note that we are only considering t >0m the transform. Of course, if we think of t as time there 
is no problem, we are generally interested in finding out what will happen in the future (Laplace 
transform is one place where it is safe to ignore the past). Let us compute some simple transforms. 



Example 6.1.1: Suppose f{t) = 1, then 
X{1} = 



I e-" dt = 




DO 




' -lim('"' M 




= lim 






io 


-s 


t=Q 


-s 


,=0 ''^'"l -^1 



The limit (the improper integral) only exists if 5 > 0. So X{1} is only defined for s > 0. 
Example 6.1.2: Suppose f{t) = e'"', then 



£{e- 



Jf~*0O /~*o 
e-"e-"'dt = 
Jo 



dt = 



-{s+a)t 



-(s + a) 



1 



s + a 



The limit only exists if 5 + a > 0. So £,{e is only defined for s + a > 0. 
Example 6.1.3: Suppose f{t) = t, then using integration by parts 

/-»oo 





tdt 


Jo 




-te-'' 


1 




+ - I e 


s 





dt 



= + 



t=0 



Again, the limit only exists if 5 > 0. 

Example 6.1.4: A common function is the unit step function, which is sometimes called the 
Heaviside function* . This function is generally given as 



u{t) 



(0 iff<0, 
1 if ? > 0. 



*The function is named after the English mathematician, engineer, and physicist Oliver Heaviside (1850-1925). 
Only by coincidence is the function "heavy" on "one side." 
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Let us find the Laplace transform of u(t - a), where a > is some constant. That is, the function 
that is for a and 1 for t > a. 

e~"u{t -a)dt = \ e~" dt = 

Ja 

where of course s > (and a > as we said before). 

By applying similar procedures we can compute the transforms of many elementary functions. 
Many basic transforms are listed in Table 6. 1 . 



m 




c 


c 

s 


t 


1 




2 




6 


f 


n\ 




1 




s+a 


sm{(jjt) 


a) 


cosipjt) 






CO 


cosh(a»0 


s 


u{t - a) 


s 




Table 6.1: Some Laplace transforms (C, a», and a are constants). 

Exercise Verify Table 6.L 

Since the transform is defined by an integral. We can use the linearity properties of the integral. 
For example, suppose C is a constant, then 

e-"Cm dt = C \ e-^'m dt = C£{fit)}. 
Jo 

So we can "pull out" a constant out of the transform. Similarly we have linearity. Since linearity is 
very important we state it as a theorem. 

Theorem 6.1.1 (Linearity of the Laplace transform). Suppose that A, B, and C are constants, then 

mm + Bg{t)} = AX{/(0} + BL{g{t)], 



and in particular 



X{C/(0} = CX{/(0}. 
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Exercise 6.1.2; Verify the theorem. That is, show that £{Af(t) + Bg(t)} = A£{f(t)} + B£{g(t)}. 

These rules together with Table 6.1 on the preceding page make it easy to find the Laplace 
transform of a whole lot of functions already. But be careful. It is a common mistake to think that 
the Laplace transform of a product is the product of the transforms. In general 

-amgit)] + nmrnm- 

It must also be noted that not all functions have a Laplace transform. For example, the function 
y does not have a Laplace transform as the integral diverges for all s. Similarly, tan t or e' do not 
have Laplace transforms. 

6.1.2 Existence and uniqueness 

Let us consider when does the Laplace transform exist in more detail. First let us consider functions 
of exponential order. The function fit) is of exponential order as t goes to infinity if 

1/(01 < Me'\ 

for some constants M and c, for sufficiently large t (say for all t> t^ for some ?o). The simplest way 
to check this condition is to try and compute 

lim — — . 

If the limit exists and is finite (usually zero), then fif) is of exponential order. 

Exercise 6.1.3; Use L'Hopital's rule from calculus to show that a polynomial is of exponential 
order. Hint: Note that a sum of two exponential order functions is also of exponential order. Then 
show that t" is of exponential order for any n. 

For an exponential order function we have existence and uniqueness of the Laplace transform. 

Theorem 6.1.2 (Existence). Let f(t) be continuous and of exponential order for a certain constant 
c. Then F{s) = X{/(0} is defined for all s > c. 

The transform also exists for some other functions that are not of exponential order, but that 
will not be relevant to us. Before dealing with uniqueness, let us note that for exponential order 
functions we obtain that their Laplace transform decays at infinity: 

lim F{s) = 0. 

Theorem 6.1.3 (Uniqueness). Let f(t) and g(t) be continuous and of exponential order Suppose 
that there exists a constant C, such that F{s) = G(s)for all s > C. Then fit) = git) for all t >0. 
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Both theorems hold for piecewise continuous functions as well. Recall that piecewise continuous 
means that the function is continuous except perhaps at a discrete set of points where it has jump 
discontinuities like the Heaviside function. Uniqueness however does not "see" values at the 
discontinuities. So we can only conclude that f{t) = g{t) outside of discontinuities. For example, 
the unit step function is sometimes defined using u(0) = Vz- This new step function, however, has 
the exact same Laplace transform as the one we defined earlier where u{0) = 1 . 



6.1.3 The inverse transform 

As we said, the Laplace transform will allow us to convert a differential equation into an algebraic 
equation. Once we solve the algebraic equation in the frequency domain we will want to get back to 
the time domain, as that is what we are interested in. If we have a function F{s), to be able to find 
f{t) such that = F{s), we need to first know if such a function is unique. It turns out we are 

in luck by Theorem 6.1.3. So we can without fear make the following definition. 

If F(s) = -C{fit)} for some function f(t). We define the inverse Laplace transform as 

£-'{F{s)]=f{t). 

There is an integral formula for the inverse, but it is not as simple as the transform itself — it requires 
complex numbers and path integrals. For us it will suffice to compute the inverse using Table 6.1 on 
page 25 1 . 

Example 6.1.5: Take F{s) = Find the inverse Laplace transform. 
We look at the table to find 

As the Laplace transform is linear, the inverse Laplace transform is also hnear. That is, 
£-'{AFis) + BGis)} = ArHFis)} + B£-'{Gis)}. 
Of course, we also have £.~^{AF{s)} = A£r^{F{s)}. Let us demonstrate how linearity can be used. 

Example 6.1.6: Take F(s) = Find the inverse Laplace transform. 

First we use the method of partial fractions to write F in a form where we can use Table 6.1 on 
page 251. We factor the denominator as s{s^ + 1) and write 

s^ + s+l _A Bs + C 
s^ + s s s^ + I 

Putting the right hand side over a common denominator and equating the numerators we get 
A(s^ + 1) + s(Bs + C) = s^ + s+l. Expanding and equating coefficients we obtain A + B = 1, C = 1, 
A = 1, and thus 5 = 0. In other words, 

s^ + s+l 1 1 

F(.s) = 



s^ + s s s^ + I 
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By linearity of the inverse Laplace transform we get 

Another useful property is the so-called shifting property or the first shifting property 

£{e-"'f(X)] = F{s + al 
where F(s) is the Laplace transform of f(t). 

Exercise 6.1.4; Derive the first shifting property fi-om the definition of the Laplace transform. 

The shifting property can be used, for example, when the denominator is a more complicated 
quadratic that may come up in the method of partial fractions. We complete the square and write 
such quadratics as (s + of + b and then use the shifting property. 

Example 6.1.7: Find £"1 (^5^). 

First we complete the square to make the denominator (s + 2f + 4. Next we find 

Putting it all together with the shifting property, we find 

£-1 ^1 = £-1 / L \ = i e-^' sin(20. 

In general, we want to be able to apply the Laplace transform to rational functions, that is 
functions of the form 

F(s) 
G(s) 

where F{s) and G(s) are polynomials. Since normally, for the functions that we are considering, 
the Laplace transform goes to zero as 5 ^ 00, it is not hard to see that the degree of F(s) must be 
smaller than that of G(s). Such rational functions are called proper rational functions and we can 
always apply the method of partial fractions. Of course this means we need to be able to factor the 
denominator into linear and quadratic terms, which involves finding the roots of the denominator. 

6.1.4 Exercises 

Exercise 6.1.5; Find the Laplace transform of 3 + t^ + sin(7rO. 

Exercise 6.1.6; Find the Laplace transform of a + bt + ct^ for some constants a, b, and c. 
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Exercise 6.1.7; Find the Laplace transform of A cos(<x»0 + B sin(cjO- 
Exercise 6.1.8; Find the Laplace transform ofcos^(a)t). 
Exercise 6.1.9; Find the inverse Laplace transform of 
Exercise 6.1.10; Find the inverse Laplace transform of 
Exercise 6.1.11; Find the inverse Laplace transform of - — -4- — r-. 



Exercise 6.1.12; Find the Laplace transform of f{t) 



\t ift>\, 
lO ift<\. 



Exercise 6.1.13; Find the inverse Laplace transform of ti — 'L, 
Exercise 6.1.14; Find the Laplace transform o/sin((x»(f - a)). 

Exercise 6.1.15; Find the Laplace transform oft sin(6>0- Flint: Several integrations by parts. 

Exercise 6.1.101; Find the Laplace transform ofA{t + 1)^. 

Exercise 6.1.102; Find the inverse Laplace transform of ^j^f;^- 

Exercise 6.1.103; Find the Laplace transform ofte~' (Hint: integrate by parts). 

Exercise 6.1.104; Find the Laplace transform ofsin{t)e~' (Hint: integrate by parts). 
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6.2 Transforms of derivatives and ODEs 

Note: 2 lectures, §7.2 -7.3 in [EPJ, §6.2 and §6.3 in [BDJ 

6.2.1 Transforms of derivatives 

Let us see how the Laplace transform is used for differential equations. First let us try to find 
the Laplace transform of a function that is a derivative. That is, suppose g(t) is a continuous 
differentiable function of exponential order. Then 

Xoo /-»oo 
e-''g'(t) dt = [e-"g{t)]l^ - i-s) e-''g(t) dt = -g(0) + s£{g(t)}. 

We repeat this procedure for higher derivatives. The results are listed in Table 6.2. The procedure 
also works for piecewise smooth functions, that is functions that are piecewise continuous with a 
piecewise continuous derivative. The fact that the function is of exponential order is used to show 
that the limits appearing above exist. We will not worry much about this fact. 



fit) 




= F(s) 




g'(t) 


sG{s) - 


giO) 




g'V) 


s'-G(s) - 


-sgiO)-, 


?'(0) 


g"'(t) 


s^G(s) - 


- s^gm - 


sg'{0)-g"iO) 



Table 6.2: Laplace transforms of derivatives {G(s) = as usual). 

Exercise 6.2.1: Verify Table 6.2. 

6.2.2 Solving ODEs with the Laplace transform 

Notice that the Laplace transform turns differentiation into multiplication by s. Let us see how to 
apply this fact to differential equations. 

Example 6.2.1: Take the equation 

x"{t) + xit) = cos(20, xiO) = 0, x'iO) = 1. 

We will take the Laplace transform of both sides. By X{s) we will, as usual, denote the Laplace 
transform of x(t). 

£{x"(t) + x(t)} = £{cos(2t)], 
s^X(s) - sx(0) - x\0) + X{s) = -r^. 



6.2. TRANSFORMS OF DERIVATIVES AND ODES 



257 



We plug in the initial conditions now — this makes the computations more streamlined — to obtain 

s^X(s)-l+X{s) = ^^. 

We solve for 

s 1 
" (52 + l)(s^ + 4) ^ 

We use partial fractions (exercise) to write 



3 ^2 + 1 3 52 + 4 ^2 + 1 • 
Now take the inverse Laplace transform to obtain 

1 1 

x(t) = - cos(0 - - cos(20 + sm(t). 

The procedure for linear constant coefficient equations is as follows. We take an ordinary 
differential equation in the time variable t. We apply the Laplace transform to transform the equation 
into an algebraic (non differential) equation in the frequency domain. All the x{t), x'{t), x"{t), and 
so on, will be converted to X(s), sX(s) - x(0), s^X(s) - sx(0) - x'(0), and so on. We solve the 
equation for X{s). Then taking the inverse transform, if possible, we find x(t). 

It should be noted that since not every function has a Laplace transform, not every equation 
can be solved in this manner. Also if the equation is not a linear constant coefficient ODE, then by 
applying the Laplace transform we may not obtain an algebraic equation. 



6.2.3 Using the Heaviside function 

Before we move on to more general equations than those we could solve before, we want to consider 
the Heaviside function. See Figure 6.1 on the next page for the graph. 



u{t) = 



(0 ifr<0, 
1 if r > 0. 



This function is useful for putting together functions, or cutting functions off. Most commonly 
it is used as u{t - a) for some constant a. This just shifts the graph to the right by a. That is, it is a 
function that is when t < a and 1 when t > a. Suppose for example that f{t) is a "signal" and you 
started receiving the signal sin t at time t = n. The function f(t) should then be defined as 



1 ift<n, 
I sin ? ift> n. 
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Figure 6.1: Plot of the Heaviside (unit step) function u(t). 



Using the Heaviside function, f{t) can be written as 

f(t) = u(t - n) sin t. 

Similarly the step function that is 1 on the interval [1,2) and zero everywhere else can be written as 

u{t- 1) - u(t-2). 

The Heaviside function is useful to define functions defined piecewise. If you want to define f(t j 
such that f(t) = t when t is in [0, 1], f{t) = -t + 2 when Hs in [1, 2] and f(t) = otherwise, you 
can use the expression 

fit) = t{u{t) - u{t - 1)) + {-t + 2) {u{t - 1) - u{t - 2)). 

Hence it is useful to know how the Heaviside function interacts with the Laplace transform. We 
have already seen that 



Jl,{u{t - a)} = . 

s 

This can be generalized into a shifting property or second shifting property. 



£{f{t - a)u{t - a)] = e'"'£{f{t)}. 



(6.1) 



Example 6.2.2: Suppose that the forcing function is not periodic. For example, suppose that we 
had a mass-spring system 

x"{t) + x{t) = fit), x{0) = 0, x'(0) = 0, 

where f(t) = lifl<?<5 and zero otherwise. We could imagine a mass-spring system, where a 
rocket is fired for 4 seconds starting at ? = 1. Or perhaps an RLC circuit, where the voltage is raised 
at a constant rate for 4 seconds starting att= 1, and then held steady again starting at f = 5. 
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We can write f(t) = u(t - 1) - u(t - 5). We transform the equation and we plug in the initial 
conditions as before to obtain 



-.V -5s 

s^X{s) + X(s) = . 

s s 



We solve for X(s) to obtain 



We leave it as an exercise to the reader to show that 



-1 



1 



^(^2 + 1) 



1 - COS t. 



In other words -£{1 - cos t] = ,^2+1) - So using (6.1) we find 



Similarly 



5(52 + 1) 



-5.S 



5(52 + 1) 



= {e-'£{l-cost}] = (1 -cosa- 1))m(?- 1). 



= X"' [e~^'£{ 1 - cos t}] = (1 - cos{t - 5)) uit - 5). 



Hence, the solution is 

x{t) = (1 - cos(? - 1)) u(t - 1) - (1 - cos(? - 5)) u{t - 5). 
The plot of this solution is given in Figure 6.2. 




Figure 6.2: Plotof 
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6.2.4 Transfer functions 

Laplace transform leads to the following useful concept for studying the steady state behavior of a 
linear system. Suppose we have an equation of the form 

Lx = fit), 

where L is a linear constant coefficient differential operator. Then f(t) is usually thought of as input 
of the system and x{t) is thought of as the output of the system. For example, for a mass-spring 
system the input is the forcing function and output is the behavior of the mass. We would like to 
have an convenient way to study the behavior of the system for different inputs. 

Let us suppose that all the initial conditions are zero and take the Laplace transform of the 
equation, we obtain the equation 

A(s)X(s) = F(s). 

Solving for the ratio (i) we obtain the so called transfer function H(s) = yA(s). 

X(s) 



H(s) = 



FisY 



In other words, X(s) = H(s)F(s). We obtain an algebraic dependence of the output of the system 
based on the input. We can now easily study the steady state behavior of the system given different 
inputs by simply multiplying by the transfer function. 

Example 6.2.3: Given x" + a/^x = f{t), let us find the transfer function (assuming the initial 
conditions are zero). 

First, we take the Laplace transform of the equation. 

s^X{s) + ojIX{s) = F(s). 

Now we solve for the transfer function ^(^)/F(i). 

X(s) 1 



H(s) = 



F(s) s^ + col' 



Let us see how to use the transfer function. Suppose we have the constant input f{t) = 1. Hence 
F(s) = ys, and 

1 1 



X(s) = H(s)F(s) 



s'^ + cols' 



Taking the inverse Laplace transform of X(s) we obtain 

1 - cos(cuoO 

X(t) = r . 

col 
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6.2.5 Transforms of integrals 

A feature of Laplace transforms is that it is also able to easily deal with integral equations. That is, 

equations in which integrals rather than derivatives of functions appear. The basic property, which 
can be proved by applying the definition and doing integration by parts, is 



£\ I mdT} = -F(s). 



s 



It is sometimes useful (e.g. for computing the inverse transform) to write this as 



Jo 



^ /(T)jT = i:-l|^F(5)j 



Example 6.2.4: To compute X ^ we could proceed by applying this integration rule. 



cos t. 



Example 6.2.5: An equation containing an integral of the unknown function is called an integral 
equation. For example, take 

t^ = I e''x{T) dr. 



where we wish to solve for x(t). We apply the Laplace transform and the shifting property to get 



where X(s) = £,{x(t)}. Thus 



^ -£{e'xit)] = -Xis-l), 
s s 



X(s-l) = ^ or X(s)= ^ 



We use the shifting property again 



2 (s+lf 



x(t) = 2e~'t. 



6.2.6 Exercises 

Exercise 6.2.2; Using the Heaviside function write down the piecewise function that is Ofor t <Q, 
t^ for t in [0, 1] and tfor t> \. 

Exercise 6.2.3; Using the Laplace transform solve 

mx" + ex + kx = Q, x{Q) = a, x'{0) = b, 
where m > 0, c> 0, k > 0, and c^ - 4km > (system is overdamped). 
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Exercise 6.2.4; Using the Laplace transform solve 

mx" + cx' + kx = Q, jc(0) = a, x'iG) = b, 
where m > Q, c > Q, k > Q, and — Akm < (system is underdamped). 
Exercise 6.2.5; Using the Laplace transform solve 

mx" + cx + kx = Q, jc(0) = a, x'{Qi) = b, 

where m > 0, c > 0, k > 0, and c^ = 4km (system is critically damped). 

Exercise 6.2.6; Solve x" + x = u{t - I) for initial conditions x{0) = and x'{0) = 0. 

Exercise 6.2.7; Show the differentiation of the transform property. Suppose = F{s), then 

show 



Hint: Differentiate under the integral sign. 

Exercise 6.2.8; Solve x'" + x = t^u{t - I) for initial conditions x{0) = 1 and x'{0) = 0, x"(0) = 0. 

Exercise 6.2.9; Show the second shifting property: -C{f(t - a) u(t - a)} = e'^^Xifit)}. 

Exercise 6.2.10; Let us think of the mass-spring system with a rocket from Example 6.2.2. We 
noticed that the solution kept oscillating after the rocket stopped running. The amplitude of the 
oscillation depends on the time that the rocket was fired (for 4 seconds in the example), a) Find 
a formula for the amplitude of the resulting oscillation in terms of the amount of time the rocket 
is fired, b) Is there a nonzero time (if so what is it?) for which the rocket fires and the resulting 
oscillation has amplitude (the mass is not moving)? 

Exercise 6.2.11; Define 



a) Sketch the graph off(t). b) Write down f(t) using the Heaviside function, c) Solve x" + x = fit), 
x{Qi) = 0, x'{Q) = using Laplace transform. 

Exercise 6.2.12; Find the transfer function for mx" + cx' +kx = f{t) (assuming the initial conditions 
are zero). 

Exercise 6.2.101; Using the Heaviside function u(t), write down the function 



£{-tf(t)] = F\s). 




otherwise. 



a -1)2 ifi<t<2, 

3-t if2<t<3. 
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Exercise 6.2.102; Solve x" - x = (f - l)u(t - I) for initial conditions x(0) = 1, x'(O) = 2 using the 
Laplace transform. 

Exercise 6.2.103; Find the transfer function for x' + x = f{t) (assuming the initial conditions are 
zero). 
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6.3 Convolution 

Note: 1 or L5 lectures, §7.2 in [EPJ, §6.6 in [BDJ 

6.3.1 The convolution 

We said that the Laplace transformation of a product is not the product of the transforms. All hope 
is not lost however. We simply have to use a different type of a "product." Take two functions f(t) 
and g(t) defined for t>0, and define the convolution* of f(t) and g(t) as 



if*gm= f fir)g(t-r)dT. (6.2) 
Jo 



As you can see, the convolution of two functions of t is another function of t. 
Example 6.3.1: Take f(t) = e' and g{t) = ? for f > 0. Then 



(f*gm= e\t-T)dT = e'-t-\. 
Jo 

To solve the integral we did one integration by parts. 

Example 6.3.2: Take f(t) = sin(a;0 and g(t) = cos((x>0 for t>0. Then 

(/ * g)(t) = I sin(ci;T) cos{oj{t - r)) dr. 
Jo 



We apply the identity 



Hence, 



cos(0) sin((/^) = ^ (sm{9 + if/) - sm{e - tf/)). 



1 

(/ * g)(0 = I :z (sin(a;0 - s'm(ojt - 2ojt)) dr 
2 

t 



T=0 



1 1 

- T sm(a)t) + - — cos(2a;T - cot) 

2 4co 

= ^ tshi(cot). 

The formula holds only for t > 0. We assumed that / and g are zero (or simply not defined) for 
negative t. 



Xoo 

This definition agrees witii (6.2) if you define /(f) and g{t) to be zero for f < 0. Wiien discussing tiie Laplace transform 
the definition we gave is sufficient. Convolution does occur in many other applications, however, where you may have 
to use the more general definition with infinities. 
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The convolution has many properties that make it behave like a product. Let c be a constant and 
/, g, and h be functions then 

f*g = 8*f, 

(cf) *g = f* (eg) = c(f * g), 
(f * g) * h = f * ig * h). 

The most interesting property for us, and the main result of this section is the following theorem. 
Theorem 6.3.1. Let f{t) and g{t) be of exponential type, then 

L {(/ * gm = I /(^)^(^ - ^rj = L{m\L{g{t)\. 

In other words, the Laplace transform of a convolution is the product of the Laplace transforms. 
The simplest way to use this result is in reverse. 

Example 6.3.3: Suppose we have the function of s defined by 

1 _ 1 1 

{s + V)s^ s-\-\ s^' 

We recognize the two entries of Table 6.2. That is 

= and X-'{i) = ,. 

Therefore, 

The calculation of the integral involved an integration by parts. 



6.3.2 Solving ODEs 

The next example demonstrates the full power of the convolution and the Laplace transform. We 
can give the solution to the forced oscillation problem for any forcing function as a definite integral. 

Example 6.3.4: Find the solution to 

x + dIx = fit), xiO) = 0, x'iO) = 0, 

for an arbitrary function f{t). 
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We first apply the Laplace transform to the equation. Denote the transform of x(t) by X(s) and 
the transform of f(t) by F(s) as usual. 



or in other words 



We know 



Therefore, 



or if we reverse the order 



s^X(s) + a>lX(s) = F(s), 



X{s) = F(s) ^ 



+0)1' 



£ 



-I 



sin(a»oO 



-f 

Jo 



x(t) = f(T) dr. 



r sin(a;oO . , 

x(t) = fit - r) dr. 

Jo (^0 

Let us notice one more feature of this example. We can now see how Laplace transform handles 
resonance. Suppose that f{t) = cos(co»oO- Then 

J^' sm{coQT) N 1 r' 
cos{co()(t -t)) dr = — I cos(a;()T) sm(a;o(^ - W dr. 
<^o (^0 Jo 

We have computed the convolution of sine and cosine in Example 6.3.2. Hence 

x(t) = \—]\]-t sin(a;oO I = ^ sm{coot). 
\oJol \2 / 2a)o 

Note the t in front of the sine. The solution, therefore, grows without bound as t gets large, meaning 
we get resonance. 

Similarly, we can solve any constant coefficient equation with an arbitrary forcing function f(t) 
as a definite integral using convolution. A definite integral, rather than a closed form solution, is 
usually enough for most practical purposes. It is not hard to numerically evaluate a definite integral. 

6.3.3 Volterra integral equation 

A common integral equation is the Volterra integral equation^ 

xit) = fit) + f git - T)xiT) dr, 
Jo 



*Named for the Italian mathematician Vito Volterra (1860 - 1940). 
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where f(t) and g(t) are known functions and x(t) is an unknown we wish to solve for. To find x(t), 
we apply the Laplace transform to the equation to obtain 

X{s) = Fis) + G{s)XisX 

where X{s), F{s), and G(s) are the Laplace transforms of x(t), f(t), and g(t) respectively. We find 

1 - G{s) 

To find x{t) we now need to find the inverse Laplace transform of X{s). 
Example 6.3.5: Solve 

x(t) = e~' + I smh(t - t)x(t) dr. 
Jo 

We apply Laplace transform to obtain 



X(s) = -^ + -J—-X(s), 
s+l s-^ - I 

or 



1-^ 

It is not hard to apply Table 6. 1 on page 25 1 to find 

x{t) = cosh(V20 - -Xz sinh(V2 0. 
V2 

6.3.4 Exercises 

Exercise 6.3.1; Let f(t) = f for t>Q, and g(t) = u(t - 1). Compute f * g. 

Exercise 6.3.2; Let f(t) = tfor t > 0, and g(t) = sin tfor t >0. Compute f * g. 

Exercise 6.3.3; Find the solution to 

mx" + ex +kx = fit), x(0) = 0, x'(0) = 0, 

for an arbitrary function fit), where m > 0, c > 0, > 0, and - 4km > (system is overdamped). 
Write the solution as a definite integral. 

Exercise 6.3.4; Find the solution to 

mx" + ex +kx = fit), xiO) = 0, x'iO) = 0, 

for an arbitrary function fit), where m > 0, e > 0, k > 0, and e^-Akm < (system is underdamped). 
Write the solution as a definite integral. 
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Exercise 6.3.5; Find the solution to 

mx" + cx' + kx = fit), x(0) = 0, x'(0) = 0, 

for an arbitrary function f(t), where m > 0, c > 0, k > 0, and = 4km (system is critically 
damped). Write the solution as a definite integral. 

Exercise 6.3.6; Solve 

x{t) = + I cos(? - t)x(t) dr. 



Jo 

/'■ 

Jo 

Exercise 6.3.8; Compute \ ^'^ 2 \ using convolution. 

\ (5 +4) J 



Exercise 6.3.7; Solve 

x{t) = cos t + ) cos(f - t)x(t) dr. 



2 

Exercise 6.3.9; WnYe Jown solution to x" - 2x = , x(0) = 0, x'(0) = a* a definite integral. 
//m?; Do no? try to compute the Laplace transform ofe~* . 

Exercise 6.3.101; Let f{t) = cos tfor t >0, and g(t) = e Compute f * g. 

Exercise 6.3.102; Compute {7!?} using convolution. 

Exercise 6.3.103; Solve yf' + x = sin t, jc(0) = 0, Jc'(O) = using convolution. 

Exercise 6.3.104; Solve x'" + x' = fit), xifS) = 0, Jc'(O) = 0, jc"(0) = using convolution. Write 
the result as a definite integral. 
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6.4 Dirac delta and impulse response 

Note: lorLS lecture, §7.6 in (BP I §6.5 in [BDJ 

6.4.1 Rectangular pulse 

Often in applications we study a physical system by putting in a short pulse and then seeing what 
the system does. The resulting behaviour is often called impulse response. Let us see what we mean 
by a pulse. The simplest kind of a pulse is a simple rectangular pulse defined by 

{0 if f < a, 
M if a<t <b, 
if b<t. 

See Figure 6.3 for a graph. Notice that 

(fi{t) = M{u(t -a)- u(t - b)), 
where u{t) is the unit step function. 



0^0 0.5 



2.5 3.0 



0.0 0.5 



2.0 2.5 3.0 



Figure 6.3: Sample square pulse with a = 0.5, b = I and M = 2. 



Let us take the Laplace transform of a square pulse, 

£ {ip{t)} = £ {M{u{t -a)- u{t - b))] = M 

s 

For simplicity we let a = 0, and it is convenient to set M = yt to have 

(fit) dt = 1. 
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That is, to have the pulse have "unit mass." For such a pulse we compute 



( 



u(t) - u{t - b) 



] 



\-e 
bs 



-bs 



X{^(0}=X 



b 



We generally want b to be very small. That is, we wish to have the pulse be very short and very tall. 
By letting b go to zero we arrive at the concept of the Dirac delta function. 

6.4.2 The delta function 

The Dirac delta function* is not exactly a function; it is sometimes called a generalized function. We 
avoid unnecessary details and simply say that it is an object that does not really make sense unless 
we integrate it. The motivation is that we would like a "function" 6{t) such that for any continuous 
function f{t) we have 



The formula should hold if we integrate over any interval that contains 0, not just (-oo, oo). So 6{t) 
is a "function" with all its "mass" at the single point ? = 0. In other words, for any interval [c, d] 



Unfortunately there is no such function in the classical sense. You could informally think that 6{t) 
is zero for t and somehow infinite at ? = 0. 

A good way to think about 6{t) is as a limit of short pulses whose integral is 1. For example, 
suppose that we have a square pulse ip{t) as above with a = 0, M = ^/h, that is ip{t) = l^MhliMd^^ 
Compute 



If f(t) is continuous att = 0, then for very small b, the function f(t) is approximately equal to /(O) 
on the interval [0, b]. We approximate the integral 





1 if the interval [c, d] contains 0, i.e. c <0 < d, 
otherwise. 





fit) dt 




f(0) dt = f(0). 



Therefore, 




*Named after the English physicist and mathematician Paul Adrien Maurice Dirac (1902-1984). 
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Let us therefore accept 6(t) as an object that is possible to integrate. We often want to shift 6 to 
another point, for example 5(t - a). In that case we have 

6(t - a) fit) dt = f(a). 

Note that 6(a - t) is the same object as 6(t - a). In other words, the convolution of 6(t) with f(t) is 
again f(t), 

(f*Sm= f S(t-s)f(s)ds = f(t). 
Jo 

As we can integrate 6(t), let us compute its Laplace transform. 



£ {6(t -a)}= I e-"6(t - a) dt = 
Jo 



In particular, 

£{6(t)} = l. 

Remark 6.4.1: Notice that the Laplace transform of 6(t - a) looks like the Laplace transform of 
the derivative of the Heaviside function u(t - a), if we could differentiate the Heaviside function. 
First notice 

£{u(t - a)} = . 

s 

To obtain what the Laplace transform of the derivative would be we multiply by s, to obtain 
which is the Laplace transform of 6(t - a). We see the same thing using integration, 

I 6(s - a) ds = u{t - a). 
Jo 

So in a certain sense 

" j^[u(t - a)] ^ 6(t - a) " 

This line of reasoning allows us to talk about derivatives of functions with jump discontinuities. We 
can think of the derivative of the Heaviside function u(t - a) as being somehow infinite at a, which 
is precisely our intuitive understanding of the delta function. 

Example 6.4.1: Let us compute [^|. So far we have always looked at proper rational 
functions in the s variable. That is, the numerator was always of lower degree than the denominator. 
Not so with — . We write, 

£-1 = £-1 {l + ^} = {1} + = 6(t) + 1. 

The resulting object is a generalized function and only makes sense when put underneath an integral. 
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6.4.3 Impulse response 

As we said before, in the differential equation Lx = f{t), we think of f{t) as input, and x{t) as the 
output. Often it is important to find the response to an impulse, and then we use the delta function 
in place of f(t). The solution to 

Lx = 6(t) 

is called the impulse response. 

Example 6.4.2: Solve (find the impulse response) 

x" + colx = 6{t), x(0) = 0, x'{0) = 0. (6.3) 
We first apply the Laplace transform to the equation. Denote the transform of x(t) by X(s). 

s^X(s) + colX(s) = I, and so X(s) ^ 



S^ + Ct»Q 

Taking the inverse Laplace transform we obtain 

sin(a>oO 
x{t) = . 

Let us notice something about the above example. We have proved before that when the input 
was f{t), then the solution to Lx = f{t) was given by 



r f( , sin(fa>oa-T)) 

40 = fir) dT. 

Jo 



Notice that the solution for an arbitrary input is given as convolution with the impulse response. Let 
us see why. The key is to notice that for functions x{t) and f{t). 



f{T)x{t - r) dT 



f(T)x"it-T)dr = (x"*fm. 



We simply differentiate twice under the integral*, the details are left as an exercise. And so if we 
convolve the entire equation (6.3) , the left hand side becomes 

(x" + colx) *f = {x" *f) + ojlix *f) = {x* /)" + colix * /). 

The right hand side becomes 

{6*fm = f(t). 

Therefore y{t) = (x * f){t) is the solution to 

y' + coly = f{t). 

This procedure works in general for other linear equations Lx = f(t). If you determine the impulse 
response, you also know how to obtain the output x(t) for any input f(t) by simply convolving the 
impulse response and the input f(t). 



*You should really think of the integral going over (-oo, oo) rather than over [0, t] and simply assume that f{t) and 
x{t) are continuous and zero for negative t. 
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6.4.4 Three-point beam bending 

Let us give another quite different example where delta functions turn up. In this case representing 
point loads on a steel beam. Suppose we have a beam of length L, resting on two simple supports at 
the ends. Let x denote the position on the beam, and let y{x) denote the deflection of the beam in 
the vertical direction. The deflection y{x) satisfies the Euler-Bernoulli equation* , 

where E and / are constants^ and F{x) is the force applied per unit length at position x. The situation 
we are interested in is when the force is applied at a single point as in Figure 6.4. 



F5{x - a) 




Figure 6.4: Three-point bending. 



In this case the equation becomes 

d^y 

= -F5{x - a), 

where .x; = a is the point where the mass is applied. F is the force applied and the minus sign 
indicates that the force is downward, that is, in the negative y direction. The end points of the beam 
satisfy the conditions, 

y{0) = 0, y"iO) = 0, 
y(L) = 0, y"{L) = 0. 

See § 5.2, for further information about endpoint conditions applied to beams. 

Example 6.4.3: Suppose that length of the beam is 2, and suppose that EI = I for simplicity. 
Further suppose that the force F = 1 is applied at x = 1 . That is, we have the equation 

d\ 

= - »• 

*Named for the Swiss mathematicians Jacob BernoulH (1654 - 1705), Daniel Bernoulli — nephew of Jacob — (1700 
- 1782), and Leonhard Paul Euler (1707 - 1783). 

' £■ is the elastic modulus and / is the second moment of area. Let us not worry about the details and simply think 
of these as some given constants. 
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and the endpoint conditions are 

y(0) = 0, /'(0) = 0, y(2) = 0, /'(2) = 0. 

We could integrate, but using the Laplace transform is even easier. We apply the transform in 
the X variable rather than the t variable. Let us again denote the transform of y(x) as Y{s). 

s^Y(s) - s^y(0) - s^iO) - sy"(0) - y"'(0) = -e-\ 

We notice that y{0) = and 3;"(0) = 0. Let us call Ci = y'{0) and C2 = y"'{0). We solve for Y{s), 

-e-' Ci C2 
Y{s) = ^ + 4 + ^. 

We take the inverse Laplace transform utilizing the second shifting property (6.1) to take the inverse 
of the first term. 

-{x - \ f C2 . 

y{x) = u(x - 1) + Cix + —X . 

6 6 

We still need to apply two of the endpoint conditions. As the conditions are at x = 2 we can simply 

replace u{x - 1) = 1 when taking the derivatives. Therefore, 

-(2-1)^ C2 , -1 4 

= y(2) = ^ + Ci(2) + ^2' = — + 2Ci + -C2, 

and 

= y"(2) = -^-^-^^-^^ + ^3 . 2 . 2 = -1 + 2C2. 
6 6 



Hence C2 = ^ and solving for Ci using the first equation we obtain Ci = ^. Our solution for the 
beam deflection is 

-(x - 1)^ X x^ 

y(x) = ^^u(x-l)-- + -. 

6.4.5 Exercises 

Exercise 6.4.1; Solve (find the impulse response) x" + x' + x = 6(t), x(0) = 0, x'{0) = 0. 

Exercise 6.4.2; Solve (find the impulse response) x" + 2x' + jc = 6{t), x(0) = 0, .x:'(0) = 0. 

Exercise 6.4.3; A pulse can come later and can he bigger. Solve x" + 4x = 46(t - 1), x(0) = 0, 
x'(0) = 0. 

Exercise 6.4.4; Suppose that f(t) and g(t) are dijferentiable functions and suppose that f{t) = 
g(t) = Ofor all t <0. Show that 

if * gYit) = (f * g)(t) = (f * g')it). 



6.4. DIRAC DELTA AND IMPULSE RESPONSE 



275 



Exercise 6.4.5; Suppose that Lx = 6(t), x(0) = 0, x'(0) = 0, has the solution x = e 'for t > 0. Find 
the solution to Lx = t^, x{0) = 0, x'{0) = Ofor t > 0. 

Exercise 6.4.6: Compute { ^'X^ }- 

Exercise 6.4.7 (challenging); Solve Example 6.4.3 via integrating 4 times in the x variable. 

Exercise 6.4.8; Suppose we have a beam of length 1 simply supported at the ends and suppose that 
force F = I is applied at x = \ in the downward direction. Suppose that EI = I for simplicity. Find 
the beam deflection y(x). 

Exercise 6.4.101; Solve (flnd the impulse response) x" = 5(f), xifS) = 0, x'(0) = 0. 

Exercise 6.4.102; Solve {flnd the impulse response) x' + ax = 6(t), x(0) = 0, ^'(O) = 0. 

Exercise 6.4.103; Suppose that Lx = 6(t), x(0) = 0, x'(0) = 0, has the solution x(t) = cos(t)for 
t > 0. Find (in closed form) the solution to Lx = sin(f), x(0) = 0, x'(0) = Ofor t > 0. 

Exercise 6.4.104; Compute £r^ 
Exercise 6.4.105; Compute [^^^^]- 
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Chapter 7 

Power series methods 



7.1 Power series 

Note: 1 or 1.5 lecture , §8.1 in [EP], §5.1 in [BD] 

Many functions can be written in terms of a power series 

oo 

2 ak(x - xof. 

If we assume that a solution of a differential equation is written as a power series, then perhaps we 
can use a method reminiscent of undetermined coefficients. That is, we will try to solve for the 
numbers a^. Before we can carry out this process, let us review some results and concepts about 
power series. 

7.1.1 Definition 

As we said, a power series is an expression such as 

oo 

^ ai,(x - = ao + ai(x - Xq) + ajix - Xq)^ + ai,(x - xq)^ + ■ • ■ , (7.1) 

*:=0 

where Gq, ai,a2, . . . ,ak, . . ■ and Xq are constants. Let 

n 

Snix) = ^ atix - Xq)'' = + ai{x - Xq) + a2{x - Xq)^ + aT,{x - XoY" ^ + Qnix - XqY, 

k=0 

denote the so-called partial sum. If for some x, the limit 

n 

lim Sn(x) = lim / ak{x - x^f 
277 
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exists, then we say that the series (7.1) converges at x. Note that for x = xq, the series always 
converges to gq. When (7.1) converges at any other point x 4^ jcq^ we say that (7.1) is a convergent 
power series. In this case we write 



Zai,{x - x^f = lim V a^ix - Xof 
n^co t i 



k=Q k=Q 

If the series does not converge for any point x xq, we say that the series is divergent. 
Example 7.1.1: The series 



Zl , . x^ x^ 

—x" = \+ x+ — + — + 
k\ 2 6 



k=0 

is convergent for any x. Recall that kl = 1 • 2 • 3 • • • is the factorial. By convention we define 0! = 1. 
In fact, you may recall that this series converges to e^. 



We say that (7.1) converges absolutely at x whenever the limit 

n 

lim Vlaytl \x-Xof 

rt— >oo f i 



exists. That is, the series Y,t=o\ak\ \x - xof is convergent. If (7.1) converges absolutely at x, then it 
converges at x. However, the opposite implication is not true. 

Example 7.1.2: The series 

oo ^ 



converges absolutely for all x in the interval (-1, 1). It converges at x = -1, as ^-j^ converges 
(conditionally) by the alternating series test. But the power series does not converge absolutely at 
X = -I, because 2^=1 j does not converge. The series diverges at .x: = 1. 



7.1.2 Radius of convergence 

If a power series converges absolutely at some xi, then for all x such that \x - xo\ < \xi - xo\ (that is, 
X is closer than xi to xq) we have \aic(x - Xo)''\ < \ai,(xi - xo)''\ for all k. As the numbers laidxi - Xo)''\ 
sum to some finite limit, summing smaller positive numbers \ak(x - xo)''\ must also have a finite 
limit. Therefore, the series must converge absolutely at x. We have the following result. 



Theorem 7.1.1. For a power series (7.1) , there exists a number p (we allow p = oo) called the 
radius of convergence such that the series converges absolutely on the interval (xq - p,xo + p) and 
diverges for x < xq- p and x> xq+ p. We write p = oo if the series converges for all x. 
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diverges 



converges absolutely 



diverges 




Figure 7.1: Convergence of a power series. 



See Figure 7.1. In Example 7.1.1 the radius of convergence is p = oo as the series converges 
everywhere. In Example 7.1.2 the radius of convergence is p = 1. We note that p = is another 
way of saying that the series is divergent. 

A useful test for convergence of a series is the ratio test. Suppose that 

DO 

k=0 



is a series such that the limit 



lim 

«— >oo 



Q+1 



exists. Then the series converges absolutely if L < 1 and diverges if L > 1. 

Let us apply this test to the series (7.1). That is we let Ck = ak(x - xof in the test. Compute 



L = lim 


Ck+l 


= lim 


n— »oo 


Ck 


n—>oo 



f^k+lix — X()) 



k+\ 



ak(x - xq) 



= lim 


<^k+i 


n—>oo 





\x- Xo\. 



Define A by 



lim 



O-k+l 



cik 



Then if 1 > L = A\x - Xo\ the series (7.1) converges absolutely. If A = 0, then the series always 
converges. If A > 0, then the series converges absolutely if |jc- JCol < ^a, and diverges if |-<:-xo| > ^a. 
That is, the radius of convergence is ^/a. Let us summarize. 



Theorem 7.1.2. Let 



be a power series such that 



^ auix - xof 



k=0 



lim 

/7— >C>0 



ak 



exists. If A = 0, then the radius of convergence of the series is oo. Otherwise the radius of 
convergence is ^Ia. 
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Example 7.1.3: Suppose we have the series 



k=0 



First we compute, 



A = lim 

I'— >cx> 



lim 

A'— >C>D 



-k-\ 



)-k 



V2. 



Therefore the radius of convergence is 2, and the series converges absolutely on the interval (-1, 3). 

The ratio test does not always apply. That is the limit of | ^ | might not exist. There exist more 
sophisticated ways of finding the radius of convergence, but those would be beyond the scope of 
this chapter. 

7.1.3 Analytic functions 

Functions represented by power series are called analytic functions. Not every function is analytic, 
although the majority of the functions you have seen in calculus are. 

An analytic function f{x) is equal to its Taylor series* near a point xq. That is, for x near xq we 
have 



fix) = J] 



k=Q 



k\ 



-(x - Xof 



(7.2) 



where f^''\xo) denotes the derivative of f{x) at the point xq. 




Figure 7.2: The sine function and its Taylor approximations around = of 5 and 9 degree 



*Named after the English mathematician Sir Brook Taylor (1685 - 1731). 
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For example, sine is an analytic function and its Taylor series around a:o = is given by 

(-ir 

(2/1 + 1)!' 



^ ^ Zj (2n + n! 

n=0 



In Figure 7.2 on the facing page we plot sin(x) and the truncations of the series up to degree 5 and 9. 
You can see that the approximation is very good for x near 0, but gets worse for x further away from 
0. This is what happens in general. To get a good approximation far away from xq you need to take 
more and more terms of the Taylor series. 



7.1.4 Manipulating power series 



One of the main properties of power series that we will use is that we can differentiate them term by 
term. That is, suppose that X (^kix - Xq)* is a convergent power series. Then for x in the radius of 
convergence we have 

d 



dx 



^ ak(x - Xof 



k=Q 



}kak(x- Xof \ 



k=i 



Notice that the term corresponding tok = disappeared as it was constant. The radius of conver- 
gence of the differentiated series is the same as that of the original. 

Example 7.1.4: Let us show that the exponential y = solves y' = y. First write 
Now differentiate 



k=0 



k-i^^-^y- 

We reindex the series by simply replacing k with k + \ . The series does not change, what changes is 
simply how we write it. After reindexing the series starts dXk = Q again. 



1 



itik-iy. ^Z.^((fc + i)-i)!- 



OO ^ 

^^kV 

k=0 



xK 



That was precisely the power series for that we started with, so we showed that ^[e^] = e^. 

Convergent power series can be added and multiplied together, and multiplied by constants 
using the following rules. First, we can add series by adding term by term. 



^ ak{x - Xof + ^^^^ ~ ^^^^ ^ YJ-^^ ^ ^^^^^ ~ ^^^^ 



\k=0 



I \k=Q 



I k=0 
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We can multiply by constants, 

/' oo \ oo 

^ Gkix - Xof = ^ aakix - Xof. 

V k=0 J k=0 

We can also multiply series together, 

( oo \ f ^ \ oo 

^ ak{x - Xof ^ bk(x - Xof = ^ Ck(x - xof 



\k=0 



J \k=0 



J k=0 



where Ck = aobk + a\bk-\ + • • • + Ukbo- The radius of convergence of the sum or the product is at 
least the minimum of the radii of convergence of the two series involved. 



7.1.5 Power series for rational functions 

Polynomials are simply finite power series. That is, a polynomial is a power series where the ak are 
zero for all k large enough. We can always expand a polynomial as a power series about any point 
Xo by writing the polynomial as a polynomial in {x - Xq). For example, let us write 2x^ - 3x + 4 as a 
power series around xo = I: 

2;c2 - 3jc + 4 = 3 + (jc - 1) + 2(jc - 1)^. 

In other words ao = 3, ai = 1, a2 = 2, and all other Uk = 0. To do this, we know that au = for 
all > 3 as the polynomial is of degree 2. We write ao + - 1) + ajix - if, we expand, and 
we solve for ao, a\, and a2- We could have also diff"erentiated at x = 1 and used the Taylor series 
formula (7.2) . 

Let us look at rational functions, that is, ratios of polynomials. An important fact is that a series 
for a function only defines the function on an interval even if the function is defined elsewhere. For 
example, for -1 < x < 1 we have 

= ^x'' = \+ x + x^ + --- 

This series is called the geometric series. The ratio test tells us that the radius of convergence is 1. 
The series diverges for x < -\ and x>\, even though is defined for dX\ x 1. 

We can use the geometric series together with rules for addition and multiplication of power 
series to expand rational functions around a point, as long as the denominator is not zero at xo- Note 
that as for polynomials, we could equivalently use the Taylor series expansion (7.2) . 

Example 7.1.5: Expand ^^2%^^'^ ^ power series around the origin {xo = 0) and find the radius of 
convergence. 
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First, write 1 + 2x + = (1 + x)^ = (1 - (-x)) . Now we compute 

v2 



X 



= X 



l+2x + x^ \l-(-x) 



1 



oo 



= X 



k=0 

/CO \ 

\k=0 J 



k=0 



where using the formula for the product of series we obtain, co = l, ci = -l-l = -2, C2 = 
1 + 1 + 1=3, etc Therefore 



1 + 2x + 



(-if^^kx^ = x-2x^ + 3x^ - 4x^ + 



k=l 



The radius of convergence is at least 1 . We use the ratio test 



lim 

k—^oo 



lim 



(-1)'*'*: 



So the radius of convergence is actually equal to 1. 



When the rational function is more complicated, it is also possible to use method of partial 
fractions. For example, to find the Taylor series for we write 



X + X 



x^ 



^ i + X i X 



fc=3 
*odd 



7.1.6 Exercises 

oo 

Exercise 7.1.1; Is the power series ^ e^x*^ convergent? If so, what is the radius of convergence? 



k=0 



Exercise 7.1.2; Is the power series ^ ^x* convergent? If so, what is the radius of convergence? 

k=0 

oo 

Exercise 7.1.3; Is the power series ^ k\x!^ convergent? If so, what is the radius of convergence? 



k=0 
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Exercise 7.1.4; Is the power series ^ (2k)\ ^^ ~ ^^^'^ convergent? If so, what is the radius of 

convergence? 

Exercise 7.1.5; Determine the Taylor series for sin x around the point xq = n. 

Exercise 7.1.6; Determine the Taylor series for In x around the point xq = 1, and find the radius of 
convergence. 

Exercise 7.1.7; Determine the Taylor series and its radius of convergence of around xq = 0. 

I + X 

X 

Exercise 7.1.8; Determine the Taylor series and its radius of convergence of around xq = 0. 

4- x^ 

Hint: You will not be able to use the ratio test. 

Exercise 7.1.9; Expand x^ + 5x + \ as a power series around xq = 5. 

oo 

Exercise 7.1.10; Suppose that the ratio test applies to a series ^ atx^. Show, using the ratio test, 

k=Q 

that the radius of convergence of the differentiated series is the same as that of the original series. 
Exercise 7.1.11; Suppose that f is an analytic function such that f^"\0) = n. Find /(I). 

oo 

Exercise 7.1.101; Is the power series ^ (0.1)"x" convergent? If so, what is the radius of conver- 



gence? 



n=l 



Zn\ 
— convergent? If so, what is the radius 
n" 

of convergence? 



Exercise 7.1.103; Using the geometric series, expand around xq = 2. For what x does the 
series converge? 



Exercise 7.1.104 (challenging); Find the Taylor series for x'e^ around xq = 0. 

Exercise 7.1.105 (challenging); Imagine f and g are analytic functions such that f''^\Q) = g'^''\0) 
for all large enough k. What can you say about f(x) - g(x)? 
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7.2 Series solutions of linear second order ODEs 

Note: 1 or L5 lecture , §8.2 in [BP], §5.2 and §5.3 in [BP] 

Suppose we have a linear second order homogeneous ODE of the form 

p{x)y" + q{x)y' + r{x)y = 0. 

Suppose that p(x), q{x), and r{x) are polynomials. We will try a solution of the form 

DO 

y = Yu ^''^^ ~ ^^^^ 

k=Q 

and solve for the to try to obtain a solution defined in some interval around xq. 
The point xq is called an ordinary point if p(xo) 4^ 0. That is, the functions 

g(^) r{x)_ 
p{x) p{x) 

are defined for x near xq. If pix^j = 0, then we say Xq is a singular point. Handling singular points 
is harder than ordinary points and so we now focus only on ordinary points. 

Example 7.2.1: Let us start with a very simple example 

y"-y = 0. 

Let us try a power series solution near xq = 0, which is an ordinary point. Every point is an ordinary 
point in fact, as the equation is constant coefficient. We already know we should obtain exponentials 
or the hyperbolic sine and cosine, but let us pretend we do not know this. 
We try 

oo 

y = ^ akx''. 

If we differentiate, the A: = term is a constant and hence disappears. We therefore get 

oo 

/ = Y^kakx''~\ 
k=i 

We differentiate yet again to obtain (now the = 1 term disappears) 

CO 

y" = Y^k(k- l)fli/"l 

k=2 
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We reindex the series (replace k with k + 2)to obtain 

oo 

y" = J](k + 2)(k+l)ak^2x' 

k=0 

Now we plug y and y" into the differential equation 



= y"-y 



J^(k + 2)(k+ l)ak^2X^\ - \y a^/ 

k=0 ' \k=0 ' 

oo 

= ^[(k + 2)(k+l) Uk+ix'' - afc/) 

k=0 

CO 

= Yj((k + 2) (k + 1) - a*) 



fc=0 



As y" - y is supposed to be equal to 0, we know that the coefficients of the resulting series must be 
equal to 0. Therefore, 

(k + 2)(k+ 1) ak+2 -ak = 0, or = 



(k + 2)(k + 1) 



The above equation is called a recurrence relation for the coefficients of the power series. It did 
not matter what qq or ai was. They can be arbitrary. But once we pick uq and ai, then all other 

coefficients are determined by the recurrence relation. 

Let us see what the coefficients must be. First, uq and ai are arbitrary 

a,Q Cl\ 0-2 (^0 ^3 ^1 



2' (3)(2)' (4)(3) (4)(3)(2)' (5)(4) (5)(4)(3)(2)' 

So we note that for even k, that isk = 2n we get 

_ ao 
(2n)! 

and for odd k, that is = 2n + 1 we have 

_ ai 



(2n+ 1)! 
Let us write down the series 

oo oo / \ oo ^ oo ^ 

^U2n)! (2„ + l)! I °Z^(2n)! ^^(2n + l)! 

We recognize the two series as the hyperbolic sine and cosine. Therefore, 

y = ao cosh x + a\ sinh x. 
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Of course, in general we will not be able to recognize the series that appears, since usually there 
will not be any elementary function that matches it. In that case we will be content with the series. 

Example 7.2.2: Let us do a more complex example. Suppose we wish to s,o\ve Airy's equation*, 
that is 

/' -xy = 0, 

near the point xq = 0. Note that .x;o = is an ordinary point. 
We try 

DO 

We differentiate twice (as above) to obtain 

oo 

y" = J]k(k-l)akx'"\ 

k=2 

We plug y into the equation 



J^kik-Da.x'-A-xlj^akx' 

k=2 ' ^ k=Q 

= [ J] - 1) a,/-^) - [ 1^ 



^k=2 ' ^ k=0 

We reindex to make things easier to sum 

= y"-xy = {la2 + + l){k+ 1) a,+2/) - ^k^^A- 
^ k=i / n=i / 

CO 

= 2a2 + ^((fc + 2) + 1) ak+2 - 
k=i 

Again y" - xy is supposed to be so first we notice that a2 = and also 

Uk-l 



(k + 2) (k + I) ak+2 - ak-i = 0, or ak+2 



(k + 2){k+\) 



Now we jump in steps of three. First we notice that since a2 = we must have that, as = 0, as = 0, 

an =0, etc In general a3„+2 = 0. 

The constants ao and ai are arbitrary and we obtain 

ao aj a3 ag a4 aj 

^3 = TTTT^' ^4 = 7777^^ ^6 = 77777T — 7777777777^^ ^7 



(3)(2)' (4)(3)' (6)(5) (6)(5)(3)(2)' (7)(6) (7)(6)(4)(3) ' 



*Named after the English mathematician Sir George Biddell Airy (1801 - 1892). 
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For at where kis a multiple of 3, that is k = 3n we notice that 

ao 



'^3n — 



(2)(3)(5)(6)---(3n-l)(3n) 
For Uk where k = 3n+l,we notice 



(3)(4)(6)(7)---(3n)(3n + l) 
In other words, if we write down the series for y we notice that it has two parts 

y-^ao + jx +—X +■■■ + (2)(3)(5)(6) ...(3n- l)(3nf 
' 12 504 (3)(4)(6)(7)---(3n)(3/7+ 1) 



1.1. 1 



-ao\l + ^x'+ ^g^x'' + • • • + (2)(3)(5)(6) ...Qn- mn/" ^ ' ' 
+ a,\x+-x' + —x' + ■■■+ (3)(4)(6)(7)...(3^)(3„ + i)-^'"' + " 
We define 

1 3 1 6 1 3 

y^^''^ = ^ + e'' ^m"" ^■■■ + (2)(3)(5)(6)...(3n-l)(3n) + 

y2(x) = ^ + Y^^' + + • • • + (3)(4)(6)(7) • • • (3n)(3n + I)'''"' + " " " ' 

and write the general solution to the equation as y(x) = aoyi(x) + aiy2(x). Notice from the power 
series that ji(0) = 1 and ^2(0) = 0. Also, y[(0) = and jjCO) = 1- If we obtained a solution that 
satisfies the initial conditions 3^(0) = ciq and y'(0) = a\. 

The functions yi and j2 cannot be written in terms of the elementary functions that you know. 
See Figure 7.3 for the plot of the solutions yi and yi. These functions have many interesting 
properties. For example, they are oscillatory for negative x (like solutions to y" + y = 0) and for 
positive X they grow without bound (like solutions to y" - y = 0). 

Sometimes a solution may turn out to be a polynomial. 
Example 7.2.3: Let us find a solution to the so-called Hermite 's equation of order n* is the equation 

y" - Ixy' + Iny = 0. 



*Named after the French mathematician Charles Hermite (1822-1901). 
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Figure 7.3: The two solutions yi and 3^2 to Airy's equation. 



Let us find a solution around the point Xq = 0. We try 



k=0 



We differentiate (as above) to obtain 

00 
k=i 

ca 

y" = ^ k{k - \)akx'^ 

k=2 

Now we plug into the equation 

(00 \ / ^ \ / ^ \ 

J^k{k-\) a^/-^ I - 2 J ^ katx''- M + 2n( ^ a^/ 1 
k=2 ' U=l ' U=0 ' 

(00 \ / ^ \ / ^ \ 

Y^kik- 1) a^/"^ 1 - \Y IkauA + I ^ 2na^/ j 
k=l ' H=l / V/t=0 ' 

(00 \ / CX) \ / CO 

2a2 + ^(k + 2)(k+ l)ak+2x''\ - i^lkatx^] + ilnao + ^ Inatx'' 
k=\ ' \k=i ' ^ k=i 

00 

= 2a2 + 2nao + ^((^ + 2){k + 1) a/t+2 - 2kak + 2nak)x'^. 

k=\ 

As - 2jcy' + 2ny = we have 

{2k - 2n) 

(k + 2){k+ l)ak+2 + (-2k + 2n)ak = 0, or = --. ztt^ rzak- 

{k + 2){k +1) 
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This recurrence relation actually includes a2 = -nao (which comes about from 2a2 + 2nao = 0). 
Again ao and ai are arbitrary. 

—2n 2(1 -n) 

= (2X1)'^°' ^ l3)(2r''^' 

_ 2(2 -n) _ 2\2 - n){-n) 
- IW'^ = (4)(3)(2)(1) 
_2(3-n) _ 2^(3 -«)(1 -n) 
" (5)(4) " (5)(4)(3)(2) 

Let us separate the even and odd coefficients. We find that 

2'"(-n)(2 -n)---(2m-2-n) 



«2m - 
«2m+l = 



(2m)! 

2'«(1 -n)(3-R)---(2m- 1 - n) 



(2m + 1)! 

Let us write down the two series, one with the even powers and one with the odd. 

yi(x)=l + ^x + X + X +•••, 

, 2(l-n) 3 , 2^(l-n)(3-») ^^ , 2\l - n)(3 - n)(5 - n) , , 
y2(x) = x+ — - — x' + + x' + ■■■ . 

We then write 

y(x) = ooyiix) + aiy2(x). 

We also notice that if n is a positive even integer, then yi{x) is a polynomial as all the coefficients 
in the series beyond a certain degree are zero. If n is a positive odd integer, then y2ix) is a polynomial. 
For example, if n = 4, then 

r ^ 1 ^ 2(-4) 2 ^ 2^(-4)(2 - 4) , ,2^44 

yAx) = 1 + — — — X + X = 1 - 4x^ + -X . 

2! 4! 3 

7.2.1 Exercises 

In the following exercises, when asked to solve an equation using power series methods, you should 
find the first few terms of the series, and if possible find a general formula for the /c* coefficient. 

Exercise 7.2.1; Use power series methods to solve y" + y = at the point xq = 1. 

Exercise 7.2.2; Use power series methods to solve y" + Axy = at the point xq = 0. 

Exercise 7.2.3; Use power series methods to solve y" - xy = at the point xq = 1. 
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Exercise 7.2.4; Use power series methods to solve y" + x^y = at the point xq = 0. 

Exercise 7.2.5; The methods work for other orders than second order. Try the methods of this 
section to solve the first order system y' - xy = Q at the point xq = 0. 

Exercise 7.2.6 (Chebyshev's equation of order p): a) Solve (1 - x^)y" - xy' + p^y = using power 
series methods at xq = 0. b) For what p is there a polynomial solution? 

Exercise 7.2.7; Find a polynomial solution to (x^ + l)y" - 2xy' +2y = using power series methods. 

Exercise 7.2.8; a) Use power series methods to solve (1 - x)y" + y = at the point xo = 0. b) Use 
the solution to part a) to find a solution for xy" + y = around the point xq = 1. 

Exercise 7.2.101; Use power series methods to solve y" + 2y?y = at the point xq = 0. 

Exercise 7.2.102 (challenging); We can also use power series methods in nonhomogeneous equa- 
tions, a) Use power series methods to solve y" - xy = at the point xq = 0. Hint: Recall the 
geometric series, b) Now solve for the initial condition y(0) = 0, /(O) = 0. 

Exercise 7.2.103; Attempt to solve x^y" - y = at xq = using the power series method of this 
section (xq is a singular point). Can you find at least one solution? Can you find more than one 
solution? 
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7.3 Singular points and the method of Frobenius 

Note: 1 or 1.5 lectures , §8.4 and §8.5 in [EP], §5.4 - §5.7 in [BD] 

While behaviour of ODEs at singular points is more complicated, certain singular points are not 
especially difficult to solve. Let us look at some examples before giving a general method. We may 
be lucky and obtain a power series solution using the method of the previous section, but in general 
we may have to try other things. 

7.3.1 Examples 

Example 7.3.1: Let us first look at a simple first order equation 

2xy' - y = 0. 

Note that .jc = is a singular point. If we only try to plug in 

DO 

k=0 

we obtain 

= 2xy'-y = 2x I J] katx'A - I J] a,/] 

DO 

= ao + '^(2kak - at) ^. 

k=\ 

First, ao = 0. Next, the only way to solve = Ikak - at = {2k - I) at for k = 1, 2, 3, . . . is for at = 
for all k. Therefore we only get the trivial solution y = 0. We need a nonzero solution to get the 
general solution. 

Let us try y = x'' for some real number r. Consequently our solution — if we can find one — may 
only make sense for positive x. Then y' = rx''^^ . So 

Q = 2xy' -y = 2xrx'-^ - x' = (2r - l)x''. 

Therefore r = 1/2, or in other words y = x^^^. Multiplying by a constant, the general solution for 
positive X is 

3; = Cx"\ 

Note that the solution is not even diff'erentiable at .x; = 0. The derivative necessarily must "blow up" 
at the origin, so much is clear from the diff"erential equation itself. 
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Not every problem with a singular point has a solution of the form y = , of course. But perhaps 
we can combine the methods. What we will do is to try a solution of the form 

y = xjix) 

where f(x) is an analytic function. 

Example 7.3.2: Suppose that we have the equation 

4xY -4xy + (l-2x)y = 0, 

and again note that x = is a singular point. 
Let us try 

oo CO 

where r is a real number, not necessarily an integer. Again if such a solution exists, it may only 
exist for positive x. First let us find the derivatives 



y = 2(^ + r)fl,x*+'-i. 



k=0 



y" = Yp^ + r){k + r-\) 



Jc+r-2 



k=0 

Plugging into our equation we obtain 

= 4jcV' -4jcV + (1 -2jc)); 

(oo \/^ \ / ^ \ 

J^(k + r)(k + r-l) Ukx/'^'-A - 4/ [Vik + r) akX^*"^ + (1 - 2x)\y a^/^H 

(OO \ / oo \ / oo \ / oo \ 

J]4ik + r)(k + r- 1) -\y4(k + r) fl,x*^'-+' \ + \y - I J] la^x'^'-^' 

k=0 ' U=0 ' U=0 ' U=0 ' 

(OO \/00 \/00\/00 

J]4ik + r)(k + r- 1) a^x'n - ^ 4(fc + r - 1) a.-.x'^''] + ^ - 2 2a,_ 

oo 

= 4r(r - 1) ao + ao + ^(^(^ + r)(k + r - l)ak - 4(k + r - 1) a^-i +ai,- ^a^-i) 

k=\ 

OO 

= (4r(r - 1) + 1) ao + J]({4(k + r) (A: + r - 1) + 1) a, - {4(k + r - 1) + 2) a,_i) Z^''. 
k=i 

Therefore to a solution we must first have (4r(r - 1) + 1) ao = 0. Supposing that ao ^ we obtain 

4r(r - 1) + 1 = 0. 
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This equation is called the indicial equation. This particular indicial equation has a double root at 

r = 1/2. 

OK, so we know what r has to be. That knowledge we obtained simply by looking at the 
coefficient of x^. All other coefficients of x'^'^'' also have to be zero so 

(4(k + r){k + r - I) + l)ak - {4(k + r - I) + 2)ak_i =0. 

If we plug in r = 1/2 and solve for at we get 

4(/t + 1/2 - 1) + 2 _ 1 

4(k + 1/2) (a: + 1/2 - 1) + 1 k 

Let us set = I. Then 

_1_ _1_1 11 _1_1 



1 " '22 3 - 3-2 4 4-3-2 

Extrapolating, we notice that 

1 1 



ak = 



kik - \){k - 2) • • • 3 • 2 k\ 



In other words. 



00 00 ^ 00 ^ 



That was lucky! In general, we will not be able to write the series in terms of elementary functions. 

We have one solution, let us call it y\ = x^^'^e^. But what about a second solution? If we want a 
general solution, we need two linearly independent solutions. Picking uq to be a different constant 
only gets us a constant multiple of 3^1, and we do not have any other r to try; we only have one 
solution to the indicial equation. Well, there are powers of x floating around and we are taking 
derivatives, perhaps the logarithm (the antiderivative of is around as well. It turns out we want 
to try for another solution of the form 

00 

which in our case is 

y2 = Yj^k^'"^ + (\nx)x'i^e\ 

k=0 

We would now differentiate this equation, substitute into the differential equation again and solve 
for bk- A long computation would ensue and we would obtain some recursion relation for bk- In 
fact, the reader can try this to obtain for example the first three terms 

bi=bo-l, b2 = — - — , b3 = — — — , 
We would then fix bo and obtain a solution y2. Then we write the general solution as y = Ayi + By 2. 
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7.3.2 The method of Frobenius 

Before giving the general method, let us clarify when the method applies. Let 

p(x)y" + q(x)y' + r(x)y = 
be an ODE. As before, if pixo) = 0, then xq is a singular point. If, furthermore, the limits 

lim (x-Xq) and lim {x - Xq) 

x^xo p{x) x^xo p{x) 

both exist and are finite, then we say that xq is a regular singular point. 
Example 7.3.3: Often, and for the rest of this section, xq = 0. Consider 

xy + xil+ x)y' + in + x^)y = 0. 

Write 

r r T n , ^ 1 

lim X = lim X — = lim {I + x) = 1, 

x^O p(x) x~^Q X x-^Q 

lim X —— = lim X — = lim (n + x ) = n. 

x^O p{x) x-^0 X^ J:-*0 

So is a regular singular point. 

On the other hand if we make the slight change 

jcV + (1 + + (tt + x^)^ = 0, 

then 

r ^^^^ V (1+-^) r 1+^ T>.MT3 
lim X = lim X — = lim = DNE. 

-t^O p{x) .t^O x-^Q X 

Here DNE stands for does not exist. The point is a singular point, but not a regular singular point. 

Let us now discuss the general Method of Frobenius\ Let us only consider the method at the 
point X = for simplicity. The main idea is the following theorem. 

Theorem 7.3.1 (Method of Frobenius). Suppose that 

p{x)y" + q{x)y' + r{x)y = Q (7.3) 

has a regular singular point at x = Oy then there exists at least one solution of the form 

00 

y = x'^atx''. 

k=0 

A solution of this form is called a Frobenius-type solution. 



*Named after the German mathematician Ferdinand Georg Frobenius (1849 - 1917). 
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The method usually breaks down like this. 

(i) We seek a Frobenius-type solution of the form 

oo 

We plug this y into equation (7.3) . We collect terms and write everything as a single series. 

(ii) The obtained series must be zero. Setting the first coefficient (usually the coefficient of x'') in 
the series to zero we obtain the indicial equation, which is a quadratic polynomial in r. 

(iii) If the indicial equation has two real roots ri and r2 such that r\ - ri is not an integer, then we 
have two linearly independent Frobenius-type solutions. Using the first root, we plug in 

oo 

y\ = x'' ^ a^/, 

/t=0 

and we solve for all Uk to obtain the first solution. Then using the second root, we plug in 

oo 

yi = x'-'-Yjbkx\ 

k=0 

and solve for all to obtain the second solution. 

(iv) If the indicial equation has a doubled root r, then there we find one solution 

oo 

yi= a^/, 

k=Q 

and then we obtain a new solution by plugging 

oo 

yi = x'^bkX^ + {\nx)yx, 

k=Q 

into equation (7.3) and solving for the constants bt- 

(v) If the indicial equation has two real roots such that ri - is an integer, then one solution is 

oo 

k=0 

and the second linearly independent solution is of the form 

oo 

y2 = x'-'Y,bkx'' + C(\nx)yu 

k=Q 

where we plug y2 into (7.3) and solve for the constants bt and C. 
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(vi) Finally, if the indicial equation has complex roots, then solving for Uk in the solution 

oo 
k=0 

results in a complex-valued function — all the cik are complex numbers. We obtain our two 
linearly independent solutions* by taking the real and imaginary parts of y. 

Note that the main idea is to find at least one Frobenius-type solution. If we are lucky and find 
two, we are done. If we only get one, we either use the ideas above or even a difl'erent method such 
as reduction of order (Exercise 2.1.8 on page 50) to obtain a second solution. 



7.3.3 Bessel functions 

An important class of functions that arises commonly in physics are the Bessel functions'' . For 
example, these functions arise as when solving the wave equation in two and three dimensions. First 
we have Bessel's equation of order p. 



x^y" + xy' + (^ - p^)y = Q. 



We allow p to be any number, not just an integer, although integers and multiples of 1/2 are most 
important in applications. 
When we plug 

00 

k=0 

into Bessel's equation of order p we obtain the indicial equation 

r{r - \) + r - p^ = (r - p){r + p) = 0. 

Therefore we obtain two roots ri = p and r2 = -p. If p is not an integer following the method of 
Frobenius and setting ao = 1 , we can obtain linearly independent solutions of the form 



yi 



2m(k + p)ik - 1 + p) . . . (2 + p)il + pY 



l^^k\{k - p)(k - 1 - p) ... (2 - p)(\ - p) 



*See Joseph L. Neuringera, The Frobenius method for complex roots of the indicial equation. International Journal 
of Mathematical Education in Science and Technology, Volume 9, Issue 1, 1978, . 

^Named after the German astronomer and mathematician Friedrich Wilhebn Bessel (1784 - 1846). 
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Exercise 7.3.1; a) Verify that the indicial equation ofBessel's equation of order p is {r-p){r+p) = 0. 
b) Suppose that p is not an integer. Carry out the computation to obtain the solutions y\ andy2 
above. 

Bessel functions will be convenient constant multiples of yi and ji- First we must define the 

gamma function 

f-^e-'dt. 



Notice that r(l) = 1. The gamma function also has a wonderful property 

r(jc + 1) = jcr(;c). 

From this property, one can show that r(n) = (n - 1)! when n is an integer, so the gamma function 
is a continuous version of the factorial. We compute: 

Y{k + p+\) = {k + p){k-\+p)---{2 + p){\+p)Y{\+p), 
Y{k - p + \) = {k - p){k - \ - p)- ■ ■{!- p){\ - p)Y{\ - p). 

Exercise 7.3.2; Verify the above identities using Y{x + 1) = xY{x). 

We define the Bessel functions of the first kind of order p and -p as 

1 ^ (-1)* (x\^^^P 



j-pw - _ /2 - 2^ _ ^ J 2 j 



As these are constant multiples of the solutions we found above, these are both solutions to Bessel's 
equation of order p. The constants are picked for convenience. 

When p is not an integer, Jp and 7_p are linearly independent. When n is an integer we obtain 



,__,k\ik^n)\ 
In this case it turns out that 

Ux) = (-l)V_„(x), 

and so we do not obtain a second linearly independent solution. The other solution is the so-called 

Bessel function of second kind. These make sense only for integer orders n and are defined as limits 
of linear combinations of Jp(x) and J-p(x) as p approaches n in the following way: 

1- cos(p7r)Jp(x)-J-p(x) 

Y„(x) = hm — — 7 . 

P^n sm(/77r) 
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As each linear combination of Jp(x) and J-p(x) is a solution to Bessel's equation of order p, then as 
we take the limit as p goes to n, Y„(x) is a solution to Bessel's equation of order n. It also turns out 
that Y„{x) and J„{x) are linearly independent. Therefore when n is an integer, we have the general 
solution to Bessel's equation of order n 

y = AJnix) + BYn{x), 

for arbitrary constants A and B. Note that Y„{x) goes to negative infinity at .x; = 0. Many mathematical 
software packages have these functions 7„(^) and defined, so they can be used just like say 
sin(x) and cos(x). In fact, they have some similar properties. For example, -J\{x) is a derivative of 
7o(-^), and in general the derivative of Jn{x) can be written as a linear combination of Jn-\{x) and 
7„+i(x). Furthermore, these functions oscillate, although they are not periodic. See Figure 7.4 for 
graphs of Bessel functions. 




Figure 7.4: Plot of the Jq{x) and J\{x) in the first graph and Y(){x) and Yi{x) in the second graph. 

Example 7.3.4: Other equations can sometimes be solved in terms of the Bessel functions. For 
example, given a positive constant A, 

xy" +y' + A^xy = 0, 

can be changed to x'^y" + xy' + A^x^y = 0. Then changing variables t = Axwe obtain via chain rule 
the equation in y and t: 

fy" + ty' + t^y = 0, 

which can be recognized as Bessel's equation of order 0. Therefore the general solution is y(t) = 
AJoit) + BYoit), or in terms of x: 

y = AJoiAx) + BYoiAx). 

This equation comes up for example when finding fundamental modes of vibration of a circular 
drum, but we digress. 
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7.3.4 Exercises 

Exercise 7.3.3; Find a particular (Frobenius-type) solution ofx^y" + xy' + (1 + x)y = 0. 
Exercise 7.3.4; Find a particular (Frobenius-type) solution of xy" —y = Q. 
Exercise 7.3.5; Find a particular (Frobenius-type) solution ofy" + ^j' - xy = 0. 
Exercise 7.3.6; Find the general solution ofixy" + / - ^y = 0. 
Exercise 7.3.7; Find the general solution ofx^y" - xy' - y = 0. 

Exercise 7.3.8; In the following equations classify the point x = as ordinary, regular singular, or 
singular but not regular singular. 

a) x\l + x^)y" + xy = 

b) x^y" +y' +y = 

c) xy" + JcV + y = 

d) xy" + xy' -e^'y = 

e) x^y + x^y' + x^y = 

Exercise 7.3.101; In the following equations classify the point x = as ordinary, regular singular, 
or singular but not regular singular. 

a) y" +y = 

b) xY + {l+x)y = 

c) xy" + JcV + y = 

d) sm(x)y' -y = 

e) cos{x)y' - sin(^x)y = 

Exercise 7.3.102; Find the general solution of x^y" - j = 0. 
Exercise 7.3.103; Find a particular solution ofx^y" + (x - = 0. 
Exercise 7.3.104 (Tricky); Find the general solution of x^y" - xy' + y = Q. 
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FURTHER READING 



Solutions to Selected Exercises 



0.2.101: Compute x' = -le'^' and x" = 4e-^'. Then {4e-^') + A{-2e-^*) + 4(e-^') = 0. 

0.2.102: Yes. 

0.2.103: y = x'' is a solution for r = and r = 2. 

0.2.104: Ci = 100, C2 = -90 

0.2.105: (f = -9e^' 

1.1.101: y = e' + ^+9 

1.1.102: x = i3t- 2^'^ 

1.1.103: jc = sin~^(f+ 1) 

1.1.104: 170 

1.1.105: Ifn ^ l,then3; = {{I - n)x + If n = l,then3; = e\ 

1.2.101: 



( 1 

-1 1 


1 I 
1 1 


1 1 1 11 

/ 1 / 1 1 


( 1 

/ /- 


1 1 

-/ / 


/ / 

/ / 


1 1 1 1 1 

/ / / / / 


/ / 
/ /- 










\ \ 

\ \ 


\ \ 

\ \ 


\ \ \ \ \ 

\ \ \ \ \ 


\ \ 
\ \ 


'\ \ 
1 1 


\ \ 
\ 1 


1 \ M 1 
1 1 1 ,1 1 


\ V 
\ 1 



y = is a solution such that j(0) = 0. 

1.2.102: Yes a solution exists, y' = /(jc, where f{x,y) = .)cj. The function f{x,y) is continuous 
and §^ = ■'c, which is also continuous near (0, 0). So a solution exists and is unique. (In fact j = is 
the solution). 



1.2.103 
1.2.104 

1.3.101 

1.3.102 
1.3.103 



No, the equation is not defined at {x.y') = (1,0). 

a) y' = cos y, h) y' = y cos(jc), c) y' = sin x. Justification left to reader. 

y = Ce""' 

X = e'' + 1 
x^ + X = t + 2 
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1.3.104: y=a^ 

1.3.105: sinCy) = - cos(x) + C 

1.3.106: The range is approximately 7.45 to 12.15 minutes. 

1.4.101: y = Ce-'' + Vs 

1.4.102: y = 2e=°^(2x)+i + ^ 

1.4.103: 250 grams 

1.4.104: P(5) = lOOOe^^^-'^'^^^^' = lOOOe^-^^ « 6.31 x 10^ 

1.5.101: y=^, 

1.5.102: 

1.5.103: y = {le^' + 3x+lf^ 

1.5.104: y = yjx'^ - ln(C - x) 
1.6.101: 

a) 0, 1, 2 are critical points. 

b) X = is unstable (semistable), x = 1 is stable, and x = 2 is unstable. 

c) l 

1.6.102: a) There are no critical points, b) oo 

1.6.103: a)f =fcx(M-x)+A b) ^^^^^^^ 

1.7.101: Approximately: 1.0000, 1.2397, 1.3829 
1.7.102: 

a) 0, 8, 12 

b) x(4) = 16, so errors are: 16, 8, 4. 

c) Factors are 0.5, 0.5, 0.5. 

1.7.103: a) 0, 0, b) x = is a solution so errors are: 0, 0, 0. 

2.1.101: Yes. To justify try to find a constant A such that sin(x) = Ae^ for all x. 

2.1.102: No. = g2^x_ 

2.1.103: y = 5 

2.1.104: y = Ci ln(x) + C2 

2.2.101: y = Cie(-2+^)- + €26^'^-^^' 

2.2.102: y = Cie^^ + CiXe^"" 

2.2.103: y = e'"''^ cos(( ^/4)x) - V7e^^/'* sin(( ^/4)x) 

2.2.104: y(x) = ^ ^-3^/2 + 30+2^ 

2.2.105: z(0 = 2e-'cos(0 

2.3.101: 3; = Cie^ + Cix^ + C^x^ + C4X + C5 
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2.3.102: a) P-3r^+4r-12 = 0,h)y"' -3y" +4y' -12y = 0, c)y = de^^ + Cs sin(2x) + C3 cos(2x) 

2.3.103: y = 0. 

2.3.104: No. e^e-^-e^+i =0. 

2.3.105: Yes. (Hint: First note that sm(x) is bounded. Then note that x and xsm(x) cannot be 
multiples of each other.) 
2.4.101: k = 8/9 (and larger) 
2.4.102: 

a) 0.057" +0.1/' + (1/5)/ = 

b) x(t) = Ce-'cos(V3?-y) 

c) x(t) = I0e-'cos(y/3t) + -^e-'sm(^^3t) 



a)k = 500000 b) « 0.141 c) 45000 kg d) 11250 kg 



_ -16 siii(3x)+6 cos(3x) 
y ~ 73 



a)y= 2?^±|^. h)y = Ci cos( y/lx) + C2 sin( y/lx) + 2?1±|^. 



y(x) = x^ -4x + 6 + e'^'ix - 5). 



_ Ixe'-je'+e-") log(e^^+l) 
y ~ 4 

y = ^^f^ + Cie^^ + C2e-^^^ 
a; = ^ « 0.984 C(c^) = ^ « 2.016 



16 



(col-oj-)Fo 



cos{cot) + 



m(2ojp) +m(wQ-(o^y 



a) = 2 b) 25 

= C,e'\ y2 = )^(x) = C2e^ + §^^3^ = y(x) = C,e' + ^e'' 



sin(a>0 + J, where p = y~ ^0 = 



5^2f 



5^2t , 



-3^ '3^= 3^ +3^ 

y's+yi +y2 = t,y'^+yi -y2 = t^,y[ =y3,y2=y4 

-15 

-2 

a)[u] b)[n^] 

Yes. 

No. 2['^°f«]-[f]-[Y]=d 

[?r = [?-o^][?]+[^o'] 



a)f' = [0|]^" b)f=[ 



C2/+C1 
C2/ 
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3.4.101: 

a) Eigenvalues: 4, 0, -1 Eigenvectors: 

b) f =Ci 



1 









3 







1 




5 


1 









-2 



1 



+ C2 




1 


+ C3 


3 
5 


1 









-2 



3.4.102: 



a) Eigenvalues: 



. 1+V3i 1- V3/ 



2 ' 2 

-2cos(^) 
cos(4^)+V3sin(^) 



Eigenvectors: [ i_ 73, ]' [ 1+V3, ] 

_2sm(^) 
sin(f^)-V3cos(#) 



+ C2e 



r/2 



3.4.103: x = Ci[\]e' + C2[.\]e-' 
3.4.104: f=Ci[:S^] + C2[rsS] 

3.5.101: a) Two eigenvalues: + V2 so the behavior is a saddle, b) Two eigenvalues: 1 and 2, so 
the behavior is a source, c) Two eigenvalues: +2i, so the behavior is a center (ellipses). d) Two 
eigenvalues: -1 and -2, so the behavior is a sink, e) Two eigenvalues: 5 and -3, so the behavior 
is a saddle. 

3.5.102: Spiral source. 
3.5.103: 



The solution will not move anywhere if y = 0. When y is positive, then the solution moves (with 
constant speed) in the positive x direction. When y is negative, then the solution moves (with 
constant speed) in the negative x direction. It is not one of the behaviors we have seen. 
Note that the matrix has a double eigenvalue and the general solution is x = Cit + C2 and y = Ci, 
which agrees with the above description. 



3.6.101: x = 

sin(O) + 
3.6.102: 



(ai cos( V3 0+^i sin( V3 0)+ ? (a2 cos( V2 0+^2 sin( V2 0) + 



(aa cos(0 + 



cos(2?) 



m 








f " = 


-k 


k 





m 





k 


-2k k 








m 







k -k 



X. Solution: x = 



(ai cos( t) + b\ sin( t)) + 



(a2 cos( VV^ t) + Z?2 sin( VV™ 0) + 
3.6.103: X2 = (2/5) cos( VVe - (Vs) cos(0 
3.7.101: a) 3,0,0 b) No defects. c)f=Ci 



1 
1 


e" + C2 


1 




+ C3 



1 


1 




-1 




-1 
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3.7.102: 

a) 1,1,2 

b) Eigenvalue 1 has a defect of 1 

c) X = Ci 








1 









3 


1 





+ 1 


1 


3 


-1 









-1 




-2 



„2t 



3.7.103: 

a) 2,2,2 

b) Eigenvalue 2 has a defect of 2 



c) X = Ci 



,2f 



+ C2 



1 







^ 2 








+ 1 


-1 


3 












1 



,2f 



3.7.104: A = [5 5] 
3.8.101: e'^ = 



2 

-«_<,3» 



2 



3.8.102: = 



3e' 3e^' 
2 2 

3/ 3c3' 



-e3t+4g2,_3g, 

2e2'-2e' 
_e3»+5g2<_3g< 



3.8.103: a)e'^ = [^')'}r 



(1-0 



^O.IA 



] w.^=[g:;!::i 

r 1.25 0.361 
Lo.24 1.25 J 



^Slftd* r l+2(+5?2 3t+6f 1 
:>.5.1U4. 1^ 2r+4f2 l+2t+5f\ 

3.9.101: The general solution is (particular solutions should agree with one of these): 

;c(0 = iCi(^^' + e'') + IC2(e'' - e") - 1^ y(t) = '^C^(e'' - e") + \C2(4e'' + e'') + I + i-, 

3.9.102: The general solution is (particular solutions should agree with one of these): 
x(t) = lCi(e' + e-') + ICiie' - e'') + te' y(t) = \Cx{e' - e'') + ^€2(6' + e'') + te' 

3.9.103: f = [ 1 ] (^e' -t-l) + [_\] ^e-' 

3.9.104: ^-=[i]U^^)e^''H^o^Ti^y''''-io-'-^) 
+ [_\](gsin(20 + ^cos(20 + S-^) 

4.1.101: 



4.1.102 
4.1.103 
4.1.104 



Xk = cos(2knt) + B sm{2k7rt) (for any B) 



0) - n^iY 

Ak = Ak^n^ forA: = 1,2,3,, 
x{t) = - sin(0 

X = Ce~^ and if x(0) = then C = and so x{t) = 0, so the solution is always identically 
zero. Note that one condition is always enough to guarantee a unique solution for a first order 
equation. 

4.1.105: 
4.2.101: sin(0 

4.2.102: Y (^-n)^Hnn+n')H^^n),m(nn-n') ^^^^^^^ 
n=i 



fe-in_^ cos(4^) + sin(4^) = 
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4.2.103: i - i cos(20 
4.2.104: ^ + £ cos(/iO 



4.3.101: a) I + Z cos(f ?) b) | - if cos(|0 + ^ cos(;rO - ^ cos(|0 + 

DO J 

4.3.102: a) Z sin(f b) f sin(f - ^ sin(f + | sin(f - • • • 

CO 

4.3.103: /'(O = 2 cos(n;rO 

CO 

4.3.104: a) F(t) = 1 + C + 2 ^ sin(RO b) no. 

n=l " 

\n+l 



4.3.105: a) J] — sm(nt) b) / is continuous att = "ji so the Fourier series converges to 



(-1)" 

n=\ 

f(n/2) = Obtain ^4 = Z 4^ = 1 - V3 + Vs - V? + • • • • c) Using the first 4 terms get 

^6/io5 « 0.72 (quite a bad approximation, you would have to take about 50 terms to start to get to 
within 0.01 of ^4). 

4.4.101: a)V2+ Z ^cos(fO b)i:^^sin(fO 

n=l n=l 
n odd 

oo 

4.4.102: a)cos(20 b) Z ^„^vi,{nt) 

n=l 
n odd 

4.4.103: a) f{t) b) 

oo 

4.4.104: Z;^sin(nO 

oo 

4.4.105: + 2 ^^-^ sin(nO 



4.5.101: X = sin(2;r0 + , cos(10;rO 

oo 

4.5.102: X = 2 3^ cos(2n0 

oo 

4.5.103: = + 2 2 2^ cos(n;rO 

n odd 

oo 

4.5.104: x= J?sin(7rO + X ^^^^^ cos(n;rO 



n=3 
n odd 



4.6.101: u{x, = 5 sin(;c) e^^' + 2 sin(5x) e"^^' 
4.6.102: u{x, = 1+2 cos(jc) 
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4.6.103 
4.6.104 
4.7.101 
4.7.102 



4.7.103 

4.7.104 
4.8.101 



y^-^ ^-j _ sin(2;;r(x-30)+sin(2;r(3f+;i:)) _^ cos(3;r(x-3f))-cos(3;r(3f+x)) 



4.8.102: a)3;(jc,0.1) 



u{x, t) = e'^'e'^^ for some A 
u{x, t) = Ae'' + Be' 
y{x, t) = sin(jc) (sin(0 + cos(O) 
y{x,t) = ^ sin(;rjc) sin(5;r0 + sin(27rjc) sm(10;rO 

y(x,t) = 2(-iri sin(/ix) cos(ny/2t) 

n=\ " 

y(x, t) = sin(2;c) + t sin(jc) 

x)) , cos(3;r(.ii:-3f) 
2 18;r 

x-x^-OM if0.2<jc<0.8 
0.6x ifjc<0.2 
[0.6-0.6JC ifjc>0.8 
b) y(x, 1/2) = -x + x^ c) y(x, I) = x - x^ 
4.8.103: a) XI , 1) = - V2 b) y{4, 3) = c) 3;(3, 9) = 1/2 

00 

4.9.101: u(x,y)=i:^sin(nnx)(^^^^^^) 

n=i 

4.9.102: u(x,y) = 0.1 sm(nx) (^^^^ggf ) 

00 

4.10.101: M = 1 + Z ^r" sm(ne) 

n=l 

4.10.102: u=l-x 

4.10.103: a) u = ^r^ + \ h) u = ^r^ + I + sm(2e) 



4.10.104: u(r, 0) = ^ f 

27r J-n P - 



4 ' '4 

p- - r 



2rp cos(9 - a) + 



g(a) da 



5.1.101: A„ = n = 1,2,3,... ,y„ = cos (^x) 

5.1.102: a) p(x) = 1, ^(x) = 0, r(x) = ^, ai = 1, 0:2 = 0, /3i = 1, /32 = 0. The problem is not 
regular, b) p(x) = I + x^, q{x) = x^, r(x) = I, ai = I, a2 = 0, fii = I, ^2 = 1- The problem is 
regular. 

5.2.101: y(x, t) = sm(nx) cos(4n^t) 

5.2.102: 9);,„, +ytt = (0<x<lO,t> 0), ^(0, = ^^.(0, = 0, 3;(10, = ^^.(lO, = 0, 
y(x, 0) = sin(;z-x), y^x, 0) = jc(10 - x). 



5.3.101: 

5.3.102 
6.1.101 
6.1.102 



00 . . 

yp(x, t)= Z (cosinnx) - sin(n7rx) - l) cos(n7rO. 



n odd 

Approximately 1991 centimeters 

4 + 4 + ^ 

2t^-2t+l- e-^' 
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6.1.103 

6.1.104 
6.2.101 
6.2.102 
6.2.103 
6.3.101 
6.3.102 
6.3.103 

6.3.104 

6.4.101 
6.4.102 
6.4.103 
6.4.104 
6.4.105 
7.1.101 
7.1.102 

7.1.103 



el A.^ 
2^2 



1 

1 

^2+2^+2 

fit) = {t- l)(u(t - 1) - u(t - 2)) + u(t - 2) 
x(t) = (2e'-i -f- l)u(t - 1) - 
His) = 

I (cos? + sin? - e^') 

5t - 5 sin t 
|(sinf - tcost) 

X7(T)(l-cos(r-T))rfT 

X(t) = t 

xit) = e-"' 

x(t) = (cos * sin)(r) = irsin(r) 
d(t) - sin(0 
36(t -l) + 2t 

Yes. Radius of convergence is 10. 
Yes. Radius of convergence is e. 

CO 

= -M^) so = Z (-1)"^'(^ - 2)", whicli converges for 1 < jc < 3. 



n=0 



7.1.104: 2 



('1-7)! 



f{x) - g(x) is a polynomial. Hint: Use Taylor series. 

(32 = 0, fl3 = 0, fl4 = 0, recurrence relation (for k > 5): ai, = -2ak_^, so: 



7.1.105: 
7.2.101: 

y{x) = Qq + ayx — 2a()X^ - la^x*^ + Auqx^'"^ + 4(2ix" - SflQjc'^ - 8aiX^^ + • • • 
7.2.102: d) a2 = \, and for /c > 1 we have a^. = flyt_3 + 1, so 

y(jc) = ao+«i-^+^-^^+(«o+l)-«^+(«i + l)-«'*+|-«^+(«o+2)x^+(ai+2)jc'^+|x^+(ao+3).x^+(ai+3)x^°+- • • 
b) y{x) = \x^ + x^ +x'^ + \x^ + 2x^ + Ix'' + + 3x^ + 3xi° + • • • 

7.2.103: Applying the method of this section directly we obtain = for all k and so y{x) = is 
the only solution we find. 

7.3.101: a) ordinary, b) singular but not regular singular, c) regular singular, d) regular singular, e) 
ordinary. 

7.3.102 
7.3.103 
7.3.104 



1+^ 1^ 
y = Ax ^ + Bx 2 



y = x^^^ 2 kKkiiy. -"^ (Note that for convenience we did not pick ao = 1) 

k=0 

y = Ax + Bx In(jc) 



Index 



absolute convergence, 278 
acceleration, 
addition of matrices, 90 
Airy's equation, 287 
algebraic multiplicity, 124 
amplitude, 65 
analytic functions, 280 
angular frequency, 65 
antiderivative, 14 
antidifferentiate, 14 

associated homogeneous equation, 70, 101 
atan2, 66 

augmented matrix, 95 
autonomous equation, 37 
autonomous system, 87 

beating, 78 

Bernoulli equation, 33 

Bessel function of second kind, 298 

Bessel function of the first kind, 298 

Bessel's equation, 297 

boundary conditions for a PDE, 190 

boundary value problem, 149 

catenary, U_ 

Cauchy-Euler equation, 50 

center, 112 

cgs units, 246, 247 

characteristic equation, 52 

Chebyshev's equation of order p, 291 

Chebyshev's equation of order 1, 50 

cofactor, 94 

cofactor expansion, 94 

column vector, 90 



commute, 92 

complementary solution, 70 
complete eigenvalue, 124 
complex conjugate, 106 
complex number, 53 
complex roots, 54 
constant coefficient, 51, 100 
convergence of a power series, 278 
convergent power series, 278 
converges absolutely, 278 
convolution, 264 

corresponding eigenfunction, 150 
cosine series, 178 
critical point, 37 
critically damped, 67 

d'Alembert solution to the wave equation, 208 
damped, 66 
damped motion, 62 
defect, 125 

defective eigenvalue, 125 
deficient matrix, 125 
delta function, 270 
dependent variable, 7 
determinant, 92 
diagonal matrix, 116 

matrix exponential of, 130 
diagonalization, 131 
difl'erential equation, 7 
Dirac delta function, 270 
direction field, 87 

Dirichlet boundary conditions, 180, 229 
Dirichlet problem, 215 
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displacement vector, 116 
distance, 16_ 

divergent power series, 278 
dot product, 91_, 158 
dynamic damping, 123 

eigenfunction, 150, 230 
eigenfunction decomposition, 229, 234 
eigenvalue, 103, 230 

eigenvalue of a boundary value problem, 150 
eigenvector, 103 

eigenvector decomposition, 138, 145 
ellipses (vector field), 112 
elliptic PDE, ^90 
endpoint problem, 149 
envelope curves, 68 
equilibrium solution, 37 
Euler's equation, 50 
Euler's equations, 56 
Euler's formula, 53 
Euler's method, 42 
Euler-BernouUi equation, 273 
even function, 161, 176 
even periodic extension, 176 
existence and uniqueness, 20, 48, 57 
exponential growth model, 9 
exponential of a matrix, 129 
exponential order, 252 
extend periodically, 157 

first order diff"erential equation, 7 
first order linear equation, 27 
first order linear system of ODEs, 99 
first order method, 43 
first shifting property, 254 
forced motion, 62 

systems, 121 
Fourier series, 159 
fourth order method, 44 
Fredholm alternative 

simple case, 154 



Sturm-Liouville problems, 233 
free motion, 62 
free variable, 96 
Frobenius method, 295 
Frobenius-type solution, 295 
fundamental matrix, 100 
fundamental matrix solution, 100, 130 

general solution, 10 
generalized eigenvectors, 125, 127 
generalized function, 270 
Genius software, 5_ 
geometric multiplicity, 124 
geometric series, 226, 282 
Gibbs phenomenon, 164 

half period, 167 
harmonic function, 214 
harvesting, 39 
heat equation, 190 
Heaviside function, 250 
Hermite's equation of order n, 288 
Hermite's equation of order 2, 50 
homogeneous equation, 34 
homogeneous linear equation, 47 
homogeneous side conditions, 191 
homogeneous system, 100 
Hooke's law, 62, 115 
hyperbolic PDE, 190 

identity matrix, 91 
imaginary part, 54 
implicit solution, 24 
impulse response, 269, 272 
inconsistent system, 96 
indefinite integral, 14 
independent variable, 7 
indicial equation, 294 
initial condition, 
initial conditions for a PDE, 190 
inner product, 91 
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inner product of functions, 159, 233 
integral equation, 261, 266 
integrate, 14 
integrating factor, 27 
integrating factor method, 27 

for systems, 136 
inverse Laplace transform, 253 
invertible matrix, 92 
lODE software, 5_ 

Lab 1, 18 

Lab II, 42 

Project I, \S_ 

Project II, 42 

Project III, 57 

Project IV, 267 

Project V, 267 

la vie, 72 

Laplace equation, 190, 214 
Laplace transform, 249 
Laplacian, 214 

Laplacian in polar coordinates, 221 
leading entry, 96 
Leibniz notation, 15, 22 
linear combination, 48^, 57 
linear equation, 27, 47 
linear first order system, 87 
linear operator, 48, 70 
Hnear PDE, ^90 

linearity of the Laplace transform, 25 1 
linearly dependent, 57 
hnearly independent, 49, 57 

for vector valued functions, 100 
logistic equation, 38_ 

with harvesting, 39 

mass matrix, 116 
mathematical model, 9_ 
mathematical solution, 9_ 
matrix, 90 

matrix exponential, 129 



matrix inverse, 92 
matrix valued function, 99 
Method of Frobenius, 295 
method of partial fractions, 253 
Mixed boundary conditions, 229 
mks units, 65^, 69, 185 
multiplication of complex numbers, 53 
multiplicity, 60 

multiplicity of an eigenvalue, 124 

natural (angular) frequency, 65 
natural frequency, 77, 118 
natural mode of oscillation, 118 
Neumann boundary conditions, 180, 229 
Newton's law of cooling, 25, 31, 37 
Newton's second law, 62, 63^, 86^, 115 
nilpotent, 131 

normal mode of oscillation, 118 

odd function, 161, 176 
odd periodic extension, 176 
ODE, 8^ 

one-dimensional heat equation, 190 
one-dimensional wave equation, 201 
operator, 48^ 

ordinary differential equation, 8 
ordinary point, 285 
orthogonal 

functions, 153, 159 

vectors, 157 

with respect to a weight, 233 
orthogonality, 153 
overdamped, 67 

parabolic PDE, 190 

parallelogram, 93 

partial differential equation, 8, 190 

partial sum, 277 

particular solution, 10, 70 

PDE, 8, 190 

period, 65 
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periodic, 157 

phase diagram, 38 

phase portrait, 38, 88 

phase shift, 65 

Picard's theorem, 20 

piecewise continuous, 170 

piecewise smooth, 170 

Poisson kernel, 225 

power series, 277 

practical resonance, 82, 189 

practical resonance amplitude, 81 

practical resonance frequency, 8 1 

product of matrices, 91 

projection, 159 

proper rational function, 254 

pseudo-frequency, 68 

pure resonance, 79, 187 

quadratic formula, 52 

radius of convergence, 278 

ratio test for series, 279 

real part, 54 

real world problem, 8^ 

recurrence relation, 286 

reduced row echelon form, 96 

reduction of order method, 50 

regular singular point, 295 

regular Sturm-Liouville problem, 231 

reindexing the series, 281 

repeated roots, 59 

resonance, 79, 122, 187, 266 

RLC circuit, 62 

Robin boundary conditions, 229 
row vector, 90 
Runge-Kutta method, 46 

saddle point. 111 
sawtooth, 160 
scalar, 90 

scalar multiplication, 90 



second order differential equation, 1 1 
second order linear differential equation, 47 
second order method, 43 
second shifting property, 258 
semistable critical point, 39 
separable, 22 

separation of variables, 191 
shifting property, 254, 258 
side conditions for a PDE, 190 
simple harmonic motion, 65 
sine series, 178 
singular matrix, 92 
singular point, 285 
singular solution, 24 
sink, no 
slope field, 1 8 
solution, ]_ 
solution curve, SS_ 
source, 1 10 
spiral sink, 1 13 
spiral source, 112 
square wave, 82, 162 
stable critical point, 37 
stable node, 1 10 

steady periodic solution, 81, 184 
steady state temperature, 199, 214 
stiff problem, 45 
stiffness matrix, 116 
Sturm-Liouville problem, 230 

regular, 231 
superposition, 47, 57^, 100, 191 
symmetric matrix, 153, 157 
system of differential equations, 85 

Taylor series, 280 

tedious, 72, TSTSO, Ul_, 225 

thermal conductivity, 190 

three mass system, 1 15 

three-point beam bending, 273 

timbre, 238 

trajectory, 88 
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transfer function, 260 
transient solution, 81 
transpose, 91 
trigonometric series, 159 

undamped, 64 
undamped motion, 62 

systems, 115 
underdamped, 68 
undetermined coefficients, 7]_ 

for second order systems, 121, 144 

for systems, 141 
unforced motion, 62 
unit step function, 250 
unstable critical point, 37 
unstable node, 1 10 
upper triangular matrix, 126 

variation of parameters, 73 

for systems, 143 
vector, 90 
vector fiefd, 87 
vector vaf ued function, 99 
veiocity, 16 

Volterra integral equation, 266 



wave equation, ^90, 20]_, 208 
weight function, 232 



